Nov 04 18:44:30 devstack cinder-volume[76140]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 18:44:30 devstack cinder-volume[76140]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 18:44:30 devstack cinder-volume[76140]: we strongly recommend against using it for new projects. Nov 04 18:44:30 devstack cinder-volume[76140]: If you are already using Eventlet, we recommend migrating to a different Nov 04 18:44:30 devstack cinder-volume[76140]: framework. For more detail see Nov 04 18:44:30 devstack cinder-volume[76140]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 18:44:30 devstack cinder-volume[76140]: import eventlet # noqa Nov 04 18:44:33 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:44:33 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:44:33 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:44:34 devstack cinder-volume[76140]: INFO dbcounter [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Registered counter for database cinder Nov 04 18:44:34 devstack cinder-volume[76140]: DEBUG oslo_db.sqlalchemy.engines [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:44:35 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writer thread running {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:44:35 devstack cinder-volume[76140]: INFO cinder.rpc [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 18:44:35 devstack cinder-volume[76140]: INFO cinder.rpc [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 18:44:35 devstack cinder-volume[76140]: DEBUG oslo_db.sqlalchemy.engines [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:44:35 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Determined volume DB was empty at startup. Nov 04 18:44:35 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76140) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 18:44:35 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 18:44:35 devstack cinder-volume[76140]: WARNING stevedore.named [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:44:35 devstack cinder-volume[76140]: WARNING castellan.key_manager [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:44:35 devstack cinder-volume[76140]: WARNING cinder.keymgr.conf_key_mgr [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:44:35 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76140) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 04 18:44:35 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:35 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] CMD "cinder-rtstool verify" returned: 0 in 0.432s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:35 devstack cinder-volume[76140]: DEBUG oslo_db.sqlalchemy.engines [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:44:35 devstack cinder-volume[76140]: INFO cinder.rpc [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 04 18:44:35 devstack cinder-volume[76140]: INFO cinder.rpc [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 04 18:44:35 devstack cinder-volume[76140]: WARNING stevedore.named [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:44:35 devstack cinder-volume[76140]: WARNING castellan.key_manager [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:44:35 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_db.sqlalchemy.engines [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:44:36 devstack cinder-volume[76140]: INFO oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Starting 1 workers Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Started child 76297 {{(pid=76140) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Full set of CONF: {{(pid=76140) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] ******************************************************************************** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Configuration options gathered from: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 18:44:36 devstack cinder-volume[76297]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] ================================================================================ {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] allow_availability_zone_fallback = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] allow_compression_on_image_upload = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] allowed_direct_url_schemes = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] api_rate_limit = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] auth_strategy = keystone {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] az_cache_duration = 3600 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_availability_zone = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_host = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_stats_polling_interval = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backup_api_class = cinder.backup.api.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backup_name_template = backup-%s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backup_use_same_host = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backup_use_temp_snapshot = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] chap_password = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] chap_username = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cinder_internal_tenant_project_id = eb8c08516430408bafb8f1de4354a6eb {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cinder_internal_tenant_user_id = fd695a65fe2f451d95c9d1af7156f66a {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cloned_volume_same_az = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cluster = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] compression_format = gzip {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] compute_api_class = cinder.compute.nova.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] config_dir = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] config_source = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] control_exchange = openstack {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] debug = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] default_availability_zone = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] default_group_type = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] default_volume_type = lvmdriver-1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] disk_geometry = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] driver_client_cert = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] driver_client_cert_key = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] driver_data_namespace = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] driver_ssl_cert_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] driver_ssl_cert_verify = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] driver_use_ssl = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] enable_force_upload = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] enable_new_services = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] enable_unsupported_driver = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] enabled_backends = ['lvmdriver-1'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] enforce_multipath_for_image_xfer = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] filter_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance_api_insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance_api_servers = ['http://192.168.122.120/image'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance_api_ssl_compression = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance_ca_certificates_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance_catalog_info = image:glance:publicURL {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance_certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance_keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance_num_retries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance_request_timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] goodness_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] graceful_shutdown_timeout = 5 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] group_api_class = cinder.group.api.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] host = devstack {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_compress_on_upload = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_conversion_address_space_limit = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_conversion_cpu_limit = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_conversion_disable = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_introspection_address_space_limit = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_introspection_cpu_limit = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_upload_use_cinder_backend = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_upload_use_internal_tenant = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_volume_cache_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_volume_cache_max_count = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] image_volume_cache_max_size_gb = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] init_host_max_objects_retrieval = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] instance_format = [instance: %(uuid)s] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] iscsi_target_flags = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] iscsi_write_cache = on {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] iser_helper = tgtadm {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] iser_ip_address = 192.168.122.120 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] iser_port = 3260 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] log_color = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] log_config_append = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] log_dir = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] log_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] log_options = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] log_rotate_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] log_rotate_interval_type = days {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] log_rotation_type = none {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] max_age = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] max_logfile_count = 30 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] max_logfile_size_mb = 200 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] max_over_subscription_ratio = 20.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] message_reap_interval = 86400 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] message_ttl = 2592000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] migration_create_volume_timeout_secs = 300 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] monkey_patch = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76297]: INFO cinder.volume.manager [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] monkey_patch_modules = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] my_ip = 192.168.122.120 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] no_snapshot_gb_quota = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] num_iser_scan_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] num_shell_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] num_volume_device_scan_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] nvmeof_conn_info_version = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] nvmet_ns_id = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] nvmet_port_id = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] osapi_max_limit = 1000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] osapi_volume_ext_list = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] osapi_volume_listen = 0.0.0.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] osapi_volume_listen_port = 8776 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] osapi_volume_use_ssl = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] osapi_volume_workers = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] per_volume_size_limit = -1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] periodic_fuzzy_delay = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] periodic_interval = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] project_id_regex = [0-9a-f\-]+ {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] public_endpoint = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] publish_errors = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] quota_backup_gigabytes = 1000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] quota_backups = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] quota_gigabytes = 1000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] quota_groups = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] quota_snapshots = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] quota_volumes = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] rate_limit_burst = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] rate_limit_except_level = CRITICAL {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] rate_limit_interval = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] reinit_driver_count = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] replication_device = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] report_discard_supported = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] report_interval = 120 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] reservation_clean_interval = 86400 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] reservation_expire = 86400 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] reserved_image_namespaces = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] reserved_percentage = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] rpc_response_timeout = 120 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] run_external_periodic_tasks = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] scst_target_driver = iscsi {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] scst_target_iqn_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_down_time = 720 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] shell_completion = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] snapshot_name_template = snapshot-%s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] snapshot_same_host = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] split_loggers = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] state_path = /opt/stack/data/cinder {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] storage_availability_zone = nova {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] storage_protocol = iSCSI {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] syslog_log_facility = LOG_USER {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] target_helper = lioadm {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] target_ip_address = 192.168.122.120 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] target_port = 3260 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] target_protocol = iscsi {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] target_secondary_ip_addresses = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] trace_flags = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] transfer_api_class = cinder.transfer.api.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] transport_url = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] until_refresh = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] use_chap_auth = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] use_default_quota_class = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] use_journal = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] use_json = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] use_multipath_for_image_xfer = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] use_stderr = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] use_syslog = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] verify_glance_signatures = enabled {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_api_class = cinder.volume.api.API {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_backend_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_clear = zero {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_clear_ionice = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_clear_size = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_copy_bps_limit = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_dd_blocksize = 1M {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_name_template = volume-%s {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_service_inithost_offload = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volume_usage_audit_period = month {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] zoning_mode = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_concurrency.disable_process_locking = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.auth_section = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.auth_type = password {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.auth_version = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.cache = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.delay_auth_decision = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.http_connect_timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.include_service_catalog = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.interface = public {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_password = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcache_username = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.region_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.service_token_roles_required = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.service_type = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.token_cache_time = 300 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.120/identity {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.backend = dogpile.cache.null {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.backend_argument = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.backend_expiration_time = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.config_prefix = cache.oslo {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.debug_cache_backend = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.enable_retry_client = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.enable_socket_keepalive = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.expiration_time = 600 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.hashclient_retry_attempts = 2 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.memcache_dead_retry = 300 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.memcache_pool_maxsize = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.memcache_sasl_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.password = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.proxies = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.redis_db = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.redis_sentinel_service_name = mymaster {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.redis_server = localhost:6379 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.retry_attempts = 2 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.retry_delay = 0.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.socket_keepalive_count = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.socket_keepalive_idle = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.socket_keepalive_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.socket_timeout = 1.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.tls_allowed_ciphers = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.tls_cafile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.tls_certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.tls_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.tls_keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cache.username = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] coordination.backend_url = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.asyncio_connection = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.asyncio_slave_connection = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.backend = sqlalchemy {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.connection = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.connection_debug = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.connection_parameters = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.connection_recycle_time = 3600 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.connection_trace = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.db_inc_retry_interval = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.db_max_retries = 20 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.db_max_retry_interval = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.db_retry_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.max_overflow = 50 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.max_pool_size = 5 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.max_retries = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.mysql_wsrep_sync_wait = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.pool_timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.retry_interval = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.slave_connection = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.sqlite_synchronous = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.synchronous_reader = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] database.use_db_reconnect = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_tracing.insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack sudo[76301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 04 18:44:36 devstack sudo[76301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler.connection_string = messaging:// {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler.enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler.es_doc_type = notification {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler.es_scroll_size = 10000 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler.es_scroll_time = 2m {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler.filter_error_trace = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler.hmac_keys = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler.sentinel_service_name = mymaster {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler.socket_timeout = 0.1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler.trace_requests = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler.trace_sqlalchemy = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler_jaeger.process_tags = {} {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler_jaeger.service_name_prefix = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] profiler_otlp.service_name_prefix = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_policy.enforce_new_defaults = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_policy.policy_default_rule = default {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_policy.policy_file = policy.yaml {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_policy.remote_timeout = 60.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] privsep_osbrick.group = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] privsep_osbrick.helper_command = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] privsep_osbrick.user = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cinder_sys_admin.group = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cinder_sys_admin.helper_command = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] cinder_sys_admin.user = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.auth_section = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.auth_type = password {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.cafile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.collect_timing = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.send_service_user_token = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.split_loggers = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.tls_ciphers = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] service_user.tls_min_version = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.auth_section = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.auth_type = password {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.collect_timing = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.region_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.split_loggers = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.tls_ciphers = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] glance.tls_min_version = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.backend_availability_zone = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.chap_password = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.chap_username = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.disk_geometry = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.driver_client_cert = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.driver_client_cert_key = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.driver_data_namespace = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.driver_use_ssl = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.enable_unsupported_driver = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.extra_capabilities = {} {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.filter_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.goodness_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.iscsi_target_flags = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.iscsi_write_cache = on {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.iser_helper = tgtadm {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.iser_ip_address = 192.168.122.120 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.iser_port = 3260 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.lvm_mirrors = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.lvm_share_target = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.lvm_type = auto {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.num_shell_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.nvmet_port_id = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.replication_device = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.report_discard_supported = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.reserved_percentage = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.scst_target_driver = iscsi {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.scst_target_iqn_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.storage_protocol = iSCSI {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.target_helper = tgtadm {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.target_ip_address = 192.168.122.120 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.target_port = 3260 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.target_protocol = iscsi {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.trace_flags = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.unique_fqdn_network = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.use_chap_auth = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.volume_backend_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.volume_clear = zero {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.volume_clear_ionice = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.volume_clear_size = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.volume_group = cinder-volumes {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_reports.file_event_handler = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_reports.log_dir = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.backend_availability_zone = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.backend_host = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.chap_password = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.chap_username = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.chiscsi_conf = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.disk_geometry = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.driver_client_cert = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.driver_data_namespace = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.driver_use_ssl = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.extra_capabilities = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.filter_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.goodness_function = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.iser_helper = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.iser_ip_address = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.iser_port = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.iser_target_prefix = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.lvm_conf_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.lvm_mirrors = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.lvm_share_target = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.lvm_type = auto {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.num_shell_tries = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.nvmet_port_id = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.replication_device = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.report_discard_supported = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.reserved_percentage = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.scst_target_driver = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.storage_protocol = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.target_helper = lioadm {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.target_ip_address = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.target_port = 3260 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.target_protocol = iscsi {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.trace_flags = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.use_chap_auth = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.volume_clear = zero {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.volume_clear_size = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] lvmdriver-1.volumes_dir = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.ssl = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.ssl_version = {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_notifications.driver = [] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_notifications.retry = -1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] oslo_messaging_notifications.transport_url = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] key_manager.fixed_key = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.barbican_api_version = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.barbican_endpoint = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.barbican_endpoint_type = public {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.barbican_region_name = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.cafile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.collect_timing = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.number_of_retries = 60 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.retry_delay = 1 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.send_service_user_token = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.split_loggers = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.tls_ciphers = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.tls_min_version = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.verify_ssl = True {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican.verify_ssl_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican_service_user.auth_section = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican_service_user.auth_type = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican_service_user.cafile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican_service_user.certfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican_service_user.collect_timing = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican_service_user.insecure = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican_service_user.keyfile = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican_service_user.split_loggers = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican_service_user.timeout = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican_service_user.tls_ciphers = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] barbican_service_user.tls_min_version = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.approle_role_id = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.approle_secret_id = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.auth_method = approle {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.auth_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.kv_mountpoint = secret {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.kv_path = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.kv_version = 2 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.namespace = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.root_token_id = **** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.ssl_ca_crt_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.timeout = 60.0 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.token_file = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.token_role = None {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.use_ssl = False {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:44:36 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] ******************************************************************************** {{(pid=76140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 18:44:36 devstack sudo[76301]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.395s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:36 devstack sudo[76350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:44:36 devstack sudo[76350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:36 devstack sudo[76350]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.336s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 18:44:36 devstack cinder-volume[76297]: INFO cinder.brick.local_dev.lvm [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 04 18:44:36 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:37 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:37 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:37 devstack sudo[76472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:44:37 devstack sudo[76472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:37 devstack sudo[76472]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:37 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:37 devstack cinder-volume[76297]: DEBUG cinder.brick.local_dev.lvm [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76297) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 04 18:44:37 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:37 devstack sudo[76549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:44:37 devstack sudo[76549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:37 devstack sudo[76549]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:37 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.520s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:37 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:37 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:37 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:37 devstack sudo[76728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:44:37 devstack sudo[76728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:38 devstack sudo[76728]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:38 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:38 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:38 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:38 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:38 devstack sudo[76817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 04 18:44:38 devstack sudo[76817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:38 devstack sudo[76817]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:38 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.306s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:38 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:38 devstack sudo[76912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:44:38 devstack sudo[76912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:38 devstack sudo[76912]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:38 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:38 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:38 devstack sudo[76915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:44:38 devstack sudo[76915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:39 devstack sudo[76915]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:39 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.385s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:39 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:39 devstack sudo[77001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:44:39 devstack sudo[77001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:39 devstack sudo[77001]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:39 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:39 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:39 devstack sudo[77010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:44:39 devstack sudo[77010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:39 devstack sudo[77010]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:39 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:39 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:39 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:39 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:39 devstack sudo[77100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:44:39 devstack sudo[77100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:40 devstack sudo[77100]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:40 devstack cinder-volume[76297]: INFO cinder.volume.drivers.lvm [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 04 18:44:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:40 devstack sudo[77104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:44:40 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:40 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:40 devstack cinder-volume[76297]: DEBUG cinder.volume.drivers.lvm [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Updating volume stats {{(pid=76297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:44:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:40 devstack sudo[77107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:44:40 devstack sudo[77107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:40 devstack sudo[77107]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:40 devstack sudo[77110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:44:40 devstack sudo[77110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:40 devstack sudo[77110]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:40 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:40 devstack sudo[77113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:44:40 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:41 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:41 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:44:41 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:41 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:41 devstack cinder-volume[76297]: INFO cinder.volume.driver [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG cinder.volume.driver [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76297) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG oslo_db.sqlalchemy.engines [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76297) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG dbcounter [-] [76297] Writer thread running {{(pid=76297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG cinder.db.api [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Building query based on filter {{(pid=76297) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG cinder.image.image_utils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76297) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 18:44:41 devstack cinder-volume[76297]: INFO cinder.keymgr.migration [None req-70817fb4-0ccc-4510-bf6b-1b73747b003d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG cinder.volume.drivers.lvm [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Updating volume stats {{(pid=76297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:41 devstack sudo[77119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:44:41 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:41 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:41 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:41 devstack sudo[77123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:44:41 devstack sudo[77123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:42 devstack sudo[77123]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:42 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:42 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:42 devstack sudo[77128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:44:42 devstack sudo[77128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:42 devstack sudo[77128]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:42 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.335s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:42 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:42 devstack sudo[77131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:44:42 devstack sudo[77131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:42 devstack sudo[77131]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:42 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:42 devstack cinder-volume[76297]: DEBUG cinder.manager [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Notifying Schedulers of capabilities ... {{(pid=76297) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:44:42 devstack cinder-volume[76297]: INFO cinder.volume.manager [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Driver initialization completed successfully. Nov 04 18:44:42 devstack cinder-volume[76297]: INFO cinder.manager [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Initiating service 2 cleanup Nov 04 18:44:42 devstack cinder-volume[76297]: INFO cinder.manager [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Service 2 cleanup completed. Nov 04 18:44:42 devstack cinder-volume[76297]: DEBUG cinder.service [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Creating RPC server for service cinder-volume {{(pid=76297) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 18:44:42 devstack cinder-volume[76297]: DEBUG cinder.service [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76297) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 18:44:43 devstack cinder-volume[76297]: INFO cinder.volume.manager [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 04 18:44:43 devstack cinder-volume[76297]: DEBUG cinder.volume.drivers.lvm [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Updating volume stats {{(pid=76297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:44:43 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:43 devstack sudo[77137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:44:43 devstack sudo[77137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:43 devstack sudo[77137]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:43 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.367s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:43 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:43 devstack sudo[77140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:44:43 devstack sudo[77140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:43 devstack sudo[77140]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:43 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:43 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:43 devstack sudo[77145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:44:43 devstack sudo[77145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:44 devstack sudo[77145]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:44 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:44 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:44:44 devstack sudo[77148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:44:44 devstack sudo[77148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:44:44 devstack sudo[77148]: pam_unix(sudo:session): session closed for user root Nov 04 18:44:44 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:44:44 devstack cinder-volume[76297]: INFO cinder.volume.manager [None req-b0d47e1d-3f75-4b5c-81f0-46c64d7ac6d0 None None] Driver post RPC initialization completed successfully. Nov 04 18:44:46 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:44:48 devstack cinder-volume[76297]: DEBUG oslo_service.periodic_task [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running periodic task VolumeManager._thread_info {{(pid=76297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:44:48 devstack cinder-volume[76297]: DEBUG cinder.volume.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] thread count: 6 {{(pid=76297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:44:48 devstack cinder-volume[76297]: DEBUG cinder.volume.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] thread info: [<_MainThread(MainThread, started 134168207028352)>, , , , , ] {{(pid=76297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:44:52 devstack cinder-volume[76297]: DEBUG dbcounter [-] [76297] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:44:54 devstack cinder-volume[76297]: DEBUG dbcounter [-] [76297] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:45:48 devstack cinder-volume[76297]: DEBUG oslo_service.periodic_task [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:45:48 devstack cinder-volume[76297]: DEBUG cinder.volume.drivers.lvm [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Updating volume stats {{(pid=76297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:45:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:45:48 devstack sudo[79117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:45:48 devstack sudo[79117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:45:48 devstack sudo[79117]: pam_unix(sudo:session): session closed for user root Nov 04 18:45:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:45:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:45:48 devstack sudo[79120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:45:48 devstack sudo[79120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:45:48 devstack sudo[79120]: pam_unix(sudo:session): session closed for user root Nov 04 18:45:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:45:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:45:48 devstack sudo[79124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:45:48 devstack sudo[79124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:45:49 devstack sudo[79124]: pam_unix(sudo:session): session closed for user root Nov 04 18:45:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:45:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:45:49 devstack sudo[79127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:45:49 devstack sudo[79127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:45:49 devstack sudo[79127]: pam_unix(sudo:session): session closed for user root Nov 04 18:45:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:45:49 devstack cinder-volume[76297]: DEBUG cinder.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Notifying Schedulers of capabilities ... {{(pid=76297) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:45:49 devstack cinder-volume[76297]: DEBUG oslo_service.periodic_task [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running periodic task VolumeManager._thread_info {{(pid=76297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:45:49 devstack cinder-volume[76297]: DEBUG cinder.volume.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] thread count: 6 {{(pid=76297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:45:49 devstack cinder-volume[76297]: DEBUG cinder.volume.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] thread info: [<_MainThread(MainThread, started 134168207028352)>, , , , , ] {{(pid=76297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:46:48 devstack cinder-volume[76297]: DEBUG oslo_service.periodic_task [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:46:48 devstack cinder-volume[76297]: DEBUG cinder.volume.drivers.lvm [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Updating volume stats {{(pid=76297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:46:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:48 devstack sudo[82472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:46:48 devstack sudo[82472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:48 devstack sudo[82472]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:48 devstack sudo[82476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:46:48 devstack sudo[82476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:48 devstack sudo[82476]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:48 devstack sudo[82484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:46:48 devstack sudo[82484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:49 devstack sudo[82484]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:46:49 devstack sudo[82488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:46:49 devstack sudo[82488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:46:49 devstack sudo[82488]: pam_unix(sudo:session): session closed for user root Nov 04 18:46:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:46:49 devstack cinder-volume[76297]: DEBUG cinder.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Notifying Schedulers of capabilities ... {{(pid=76297) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:46:49 devstack cinder-volume[76297]: DEBUG oslo_service.periodic_task [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running periodic task VolumeManager._thread_info {{(pid=76297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:46:49 devstack cinder-volume[76297]: DEBUG cinder.volume.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] thread count: 6 {{(pid=76297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:46:49 devstack cinder-volume[76297]: DEBUG cinder.volume.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] thread info: [<_MainThread(MainThread, started 134168207028352)>, , , , , ] {{(pid=76297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:46:54 devstack cinder-volume[76297]: DEBUG dbcounter [-] [76297] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:47:48 devstack cinder-volume[76297]: DEBUG oslo_service.periodic_task [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:47:48 devstack cinder-volume[76297]: DEBUG cinder.volume.drivers.lvm [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Updating volume stats {{(pid=76297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:47:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:47:48 devstack sudo[84603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:47:48 devstack sudo[84603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:47:48 devstack sudo[84603]: pam_unix(sudo:session): session closed for user root Nov 04 18:47:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:47:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:47:48 devstack sudo[84606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:47:48 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:47:48 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root Nov 04 18:47:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:47:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:47:48 devstack sudo[84613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:47:48 devstack sudo[84613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:47:49 devstack sudo[84613]: pam_unix(sudo:session): session closed for user root Nov 04 18:47:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:47:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:47:49 devstack sudo[84616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:47:49 devstack sudo[84616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:47:49 devstack sudo[84616]: pam_unix(sudo:session): session closed for user root Nov 04 18:47:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:47:49 devstack cinder-volume[76297]: DEBUG cinder.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Notifying Schedulers of capabilities ... {{(pid=76297) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:47:49 devstack cinder-volume[76297]: DEBUG oslo_service.periodic_task [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running periodic task VolumeManager._thread_info {{(pid=76297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:47:49 devstack cinder-volume[76297]: DEBUG cinder.volume.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] thread count: 6 {{(pid=76297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:47:49 devstack cinder-volume[76297]: DEBUG cinder.volume.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] thread info: [<_MainThread(MainThread, started 134168207028352)>, , , , , ] {{(pid=76297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:48:48 devstack cinder-volume[76297]: DEBUG oslo_service.periodic_task [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:48:48 devstack cinder-volume[76297]: DEBUG cinder.volume.drivers.lvm [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Updating volume stats {{(pid=76297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 04 18:48:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:48 devstack sudo[85768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 04 18:48:48 devstack sudo[85768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:48 devstack sudo[85768]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:48 devstack sudo[85771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:48:48 devstack sudo[85771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:48 devstack sudo[85771]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:48 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:48 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 04 18:48:48 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:49 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:48:49 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 04 18:48:49 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:48:49 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Nov 04 18:48:49 devstack cinder-volume[76297]: DEBUG oslo_concurrency.processutils [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:48:49 devstack cinder-volume[76297]: DEBUG cinder.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Notifying Schedulers of capabilities ... {{(pid=76297) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:48:49 devstack cinder-volume[76297]: DEBUG oslo_service.periodic_task [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] Running periodic task VolumeManager._thread_info {{(pid=76297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:48:49 devstack cinder-volume[76297]: DEBUG cinder.volume.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] thread count: 6 {{(pid=76297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:48:49 devstack cinder-volume[76297]: DEBUG cinder.volume.manager [None req-4e5a7895-9caa-4cc9-9fac-9bc929880f0f None None] thread info: [<_MainThread(MainThread, started 134168207028352)>, , , , , ] {{(pid=76297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:48:54 devstack cinder-volume[76297]: DEBUG dbcounter [-] [76297] Writing DB stats cinder:SELECT=1 {{(pid=76297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:48:54 devstack cinder-volume[76297]: DEBUG dbcounter [-] [76297] Writing DB stats cinder:UPDATE=1 {{(pid=76297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:49:13 devstack cinder-volume[76140]: INFO oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Caught SIGTERM, stopping children Nov 04 18:49:13 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Acquiring lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:49:13 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Acquired lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:49:13 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Releasing lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:49:13 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Stop services. {{(pid=76140) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 18:49:13 devstack cinder-volume[76140]: DEBUG oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Killing children. {{(pid=76140) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 18:49:13 devstack cinder-volume[76140]: INFO oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Waiting on 1 children to exit Nov 04 18:49:18 devstack cinder-volume[76297]: DEBUG oslo_concurrency.lockutils [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Acquiring lock "singleton_lock" {{(pid=76297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:49:18 devstack cinder-volume[76297]: DEBUG oslo_concurrency.lockutils [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Acquired lock "singleton_lock" {{(pid=76297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:49:18 devstack cinder-volume[76297]: DEBUG oslo_concurrency.lockutils [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Releasing lock "singleton_lock" {{(pid=76297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:49:18 devstack cinder-volume[76297]: WARNING amqp [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:49:18 devstack cinder-volume[76297]: WARNING amqp [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:49:18 devstack cinder-volume[76140]: INFO oslo_service.backend._eventlet.service [None req-15f754d9-15a1-4b34-a040-32eecb66c0ff None None] Child 76297 exited with status 0 Nov 04 18:49:18 devstack cinder-volume[86391]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 18:49:18 devstack cinder-volume[86391]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 18:49:18 devstack cinder-volume[86391]: we strongly recommend against using it for new projects. Nov 04 18:49:18 devstack cinder-volume[86391]: If you are already using Eventlet, we recommend migrating to a different Nov 04 18:49:18 devstack cinder-volume[86391]: framework. For more detail see Nov 04 18:49:18 devstack cinder-volume[86391]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 18:49:18 devstack cinder-volume[86391]: import eventlet # noqa Nov 04 18:49:20 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:49:20 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:49:20 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:49:21 devstack cinder-volume[86391]: INFO dbcounter [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Registered counter for database cinder Nov 04 18:49:21 devstack cinder-volume[86391]: DEBUG oslo_db.sqlalchemy.engines [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86391) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:49:21 devstack cinder-volume[86391]: DEBUG dbcounter [-] [86391] Writer thread running {{(pid=86391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:49:21 devstack cinder-volume[86391]: INFO cinder.rpc [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 18:49:21 devstack cinder-volume[86391]: INFO cinder.rpc [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 18:49:21 devstack cinder-volume[86391]: DEBUG oslo_db.sqlalchemy.engines [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86391) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:49:21 devstack cinder-volume[86391]: INFO cinder.volume.manager [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Determined volume DB was empty at startup. Nov 04 18:49:21 devstack cinder-volume[86391]: DEBUG cinder.volume.manager [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86391) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 18:49:21 devstack cinder-volume[86391]: INFO cinder.volume.manager [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 04 18:49:21 devstack cinder-volume[86391]: WARNING stevedore.named [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:49:21 devstack cinder-volume[86391]: WARNING castellan.key_manager [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:49:21 devstack cinder-volume[86391]: WARNING cinder.keymgr.conf_key_mgr [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:49:22 devstack cinder-volume[86391]: INFO cinder.volume.manager [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_db.sqlalchemy.engines [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86391) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:49:22 devstack cinder-volume[86391]: INFO oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Starting 1 workers Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Started child 86637 {{(pid=86391) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Full set of CONF: {{(pid=86391) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] ******************************************************************************** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Configuration options gathered from: {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] ================================================================================ {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] allow_availability_zone_fallback = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] allow_compression_on_image_upload = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86637]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] allowed_direct_url_schemes = [] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] api_rate_limit = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] auth_strategy = keystone {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_availability_zone = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_host = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_name = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_stats_polling_interval = 60 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backup_api_class = cinder.backup.api.API {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backup_name_template = backup-%s {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backup_use_same_host = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backup_use_temp_snapshot = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] chap_password = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] chap_username = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cinder_internal_tenant_project_id = eb8c08516430408bafb8f1de4354a6eb {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cinder_internal_tenant_user_id = fd695a65fe2f451d95c9d1af7156f66a {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cluster = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] compression_format = gzip {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] compute_api_class = cinder.compute.nova.API {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] config_dir = [] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] config_source = [] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] control_exchange = openstack {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] debug = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] default_availability_zone = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] default_group_type = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] default_volume_type = QuobyteHD {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] disk_geometry = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] driver_client_cert = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] driver_client_cert_key = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] driver_data_namespace = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] driver_ssl_cert_path = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] driver_ssl_cert_verify = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] driver_use_ssl = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] enable_new_services = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] enable_unsupported_driver = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] enabled_backends = ['QuobyteHD'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] enforce_multipath_for_image_xfer = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] filter_function = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance_api_insecure = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance_api_servers = ['http://192.168.122.120/image'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance_api_ssl_compression = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance_ca_certificates_file = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance_catalog_info = image:glance:publicURL {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance_certfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance_keyfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance_num_retries = 3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance_request_timeout = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] goodness_function = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] graceful_shutdown_timeout = 5 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] group_api_class = cinder.group.api.API {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] host = devstack {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_compress_on_upload = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_conversion_address_space_limit = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_conversion_cpu_limit = 60 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_conversion_disable = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_introspection_address_space_limit = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_introspection_cpu_limit = 60 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_upload_use_cinder_backend = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_upload_use_internal_tenant = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_volume_cache_enabled = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_volume_cache_max_count = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] image_volume_cache_max_size_gb = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] init_host_max_objects_retrieval = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] instance_format = [instance: %(uuid)s] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] iscsi_target_flags = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] iscsi_write_cache = on {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] iser_helper = tgtadm {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] iser_ip_address = 192.168.122.120 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86637]: INFO cinder.volume.manager [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] iser_port = 3260 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] log_color = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86637]: DEBUG cinder.volume.drivers.remotefs [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86637) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] log_config_append = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] log_dir = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] log_file = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] log_options = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] log_rotate_interval = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] log_rotate_interval_type = days {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] log_rotation_type = none {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] max_age = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] max_logfile_count = 30 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] max_logfile_size_mb = 200 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] max_over_subscription_ratio = 20.0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] message_reap_interval = 86400 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] message_ttl = 2592000 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] migration_create_volume_timeout_secs = 300 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] monkey_patch = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] monkey_patch_modules = [] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] my_ip = 192.168.122.120 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] no_snapshot_gb_quota = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] num_iser_scan_tries = 3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] num_shell_tries = 3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] num_volume_device_scan_tries = 3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] nvmeof_conn_info_version = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] nvmet_ns_id = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] nvmet_port_id = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] osapi_max_limit = 1000 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] osapi_volume_ext_list = [] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] osapi_volume_listen = 0.0.0.0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] osapi_volume_listen_port = 8776 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] osapi_volume_use_ssl = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] osapi_volume_workers = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] per_volume_size_limit = -1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] periodic_fuzzy_delay = 60 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] periodic_interval = 60 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] project_id_regex = [0-9a-f\-]+ {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] public_endpoint = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] publish_errors = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] quota_backup_gigabytes = 1000 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] quota_backups = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] quota_gigabytes = 1000 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] quota_groups = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] quota_snapshots = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] quota_volumes = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] rate_limit_burst = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] rate_limit_except_level = CRITICAL {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] rate_limit_interval = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] reinit_driver_count = 3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] replication_device = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] report_discard_supported = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] report_interval = 120 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] reservation_clean_interval = 86400 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] reservation_expire = 86400 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] reserved_image_namespaces = [] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] reserved_percentage = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] rpc_response_timeout = 120 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] run_external_periodic_tasks = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] scst_target_driver = iscsi {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] scst_target_iqn_name = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_down_time = 720 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] shell_completion = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] snapshot_name_template = snapshot-%s {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] split_loggers = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] state_path = /opt/stack/data/cinder {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] storage_availability_zone = nova {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] storage_protocol = iSCSI {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] syslog_log_facility = LOG_USER {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] target_helper = lioadm {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] target_ip_address = 192.168.122.120 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] target_port = 3260 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] target_protocol = iscsi {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] target_secondary_ip_addresses = [] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] trace_flags = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] transfer_api_class = cinder.transfer.api.API {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] transport_url = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] until_refresh = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] use_chap_auth = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] use_default_quota_class = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] use_journal = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] use_json = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] use_multipath_for_image_xfer = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] use_stderr = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] use_syslog = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] verify_glance_signatures = enabled {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_api_class = cinder.volume.api.API {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_backend_name = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_clear = zero {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_clear_ionice = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_clear_size = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_copy_bps_limit = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_dd_blocksize = 1M {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_name_template = volume-%s {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_service_inithost_offload = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volume_usage_audit_period = month {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] zoning_mode = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_concurrency.disable_process_locking = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.auth_section = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.auth_type = password {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.auth_version = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.cache = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.certfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.delay_auth_decision = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.http_connect_timeout = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.include_service_catalog = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.insecure = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.interface = public {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.keyfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_password = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcache_username = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.region_name = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.service_token_roles_required = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.service_type = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.token_cache_time = 300 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.120/identity {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.backend = dogpile.cache.null {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.backend_argument = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.backend_expiration_time = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.config_prefix = cache.oslo {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.debug_cache_backend = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.enable_retry_client = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.enable_socket_keepalive = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.enabled = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.expiration_time = 600 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.hashclient_retry_attempts = 2 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.memcache_dead_retry = 300 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86637]: DEBUG cinder.volume.drivers.quobyte [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86637) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.memcache_pool_maxsize = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.memcache_sasl_enabled = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.password = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.proxies = [] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.redis_db = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.redis_sentinel_service_name = mymaster {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.redis_server = localhost:6379 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.retry_attempts = 2 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.retry_delay = 0.0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86637]: WARNING cinder.volume.drivers.quobyte [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.socket_keepalive_count = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.socket_keepalive_idle = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.socket_keepalive_interval = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.socket_timeout = 1.0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.tls_allowed_ciphers = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.tls_cafile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.tls_certfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.tls_enabled = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.tls_keyfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cache.username = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] coordination.backend_url = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.asyncio_connection = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.asyncio_slave_connection = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.backend = sqlalchemy {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.connection = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.connection_debug = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.connection_parameters = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86637]: WARNING cinder.volume.drivers.quobyte [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.connection_recycle_time = 3600 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.connection_trace = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.db_inc_retry_interval = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.db_max_retries = 20 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.db_max_retry_interval = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86637]: DEBUG oslo_concurrency.processutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Running cmd (subprocess): mount.quobyte {{(pid=86637) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.db_retry_interval = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.max_overflow = 50 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.max_pool_size = 5 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.max_retries = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.mysql_wsrep_sync_wait = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.pool_timeout = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.retry_interval = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.slave_connection = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.sqlite_synchronous = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.synchronous_reader = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] database.use_db_reconnect = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_tracing.insecure = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler.connection_string = messaging:// {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler.enabled = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler.es_doc_type = notification {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler.es_scroll_size = 10000 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler.es_scroll_time = 2m {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler.filter_error_trace = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler.hmac_keys = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler.sentinel_service_name = mymaster {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler.socket_timeout = 0.1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler.trace_requests = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler.trace_sqlalchemy = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler_jaeger.process_tags = {} {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler_jaeger.service_name_prefix = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] profiler_otlp.service_name_prefix = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_policy.enforce_new_defaults = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_policy.policy_default_rule = default {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_policy.policy_file = policy.yaml {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_policy.remote_timeout = 60.0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] privsep_osbrick.group = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] privsep_osbrick.helper_command = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] privsep_osbrick.user = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cinder_sys_admin.group = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cinder_sys_admin.helper_command = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] cinder_sys_admin.user = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.auth_section = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.auth_type = password {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.cafile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.certfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.collect_timing = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.insecure = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.keyfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.send_service_user_token = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.split_loggers = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.timeout = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.tls_ciphers = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] service_user.tls_min_version = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.auth_section = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.auth_type = password {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.certfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.collect_timing = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.insecure = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.keyfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.region_name = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.split_loggers = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.timeout = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.tls_ciphers = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] glance.tls_min_version = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.backend_availability_zone = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.chap_password = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.chap_username = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.disk_geometry = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.driver_client_cert = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.driver_client_cert_key = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.driver_data_namespace = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.driver_use_ssl = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.enable_unsupported_driver = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.extra_capabilities = {} {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.filter_function = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.goodness_function = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.iscsi_target_flags = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.iscsi_write_cache = on {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.iser_helper = tgtadm {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.iser_ip_address = 192.168.122.120 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.iser_port = 3260 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nas_host = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nas_login = admin {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nas_mount_options = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nas_password = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nas_private_key = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nas_share_path = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nas_ssh_port = 22 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.num_shell_tries = 3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.nvmet_port_id = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.quobyte_client_cfg = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.quobyte_volume_url = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.replication_device = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.report_discard_supported = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.reserved_percentage = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.scst_target_driver = iscsi {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.scst_target_iqn_name = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.storage_protocol = iSCSI {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.target_helper = tgtadm {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.target_ip_address = 192.168.122.120 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.target_port = 3260 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.target_protocol = iscsi {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.trace_flags = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.unique_fqdn_network = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.use_chap_auth = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.volume_backend_name = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.volume_clear = zero {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.volume_clear_ionice = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.volume_clear_size = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_reports.file_event_handler = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_reports.log_dir = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.backend_availability_zone = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.backend_host = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.chap_password = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.chap_username = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.chiscsi_conf = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.disk_geometry = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.driver_client_cert = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.driver_client_cert_key = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.driver_data_namespace = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.driver_use_ssl = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.extra_capabilities = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.filter_function = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.goodness_function = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.iscsi_target_flags = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.iscsi_write_cache = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.iser_helper = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.iser_ip_address = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.iser_port = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.iser_target_prefix = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nas_host = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nas_login = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nas_mount_options = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nas_password = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nas_private_key = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nas_share_path = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nas_ssh_port = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.num_shell_tries = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nvmet_ns_id = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.nvmet_port_id = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.replication_device = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.report_discard_supported = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.reserved_percentage = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.scst_target_driver = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.storage_protocol = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.target_helper = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.target_ip_address = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.target_port = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.target_prefix = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.target_protocol = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.trace_flags = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.unique_fqdn_network = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.use_chap_auth = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.volume_clear = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.volume_clear_ionice = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.volume_clear_size = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] QuobyteHD.volumes_dir = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.ssl = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.ssl_version = {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_notifications.driver = [] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_notifications.retry = -1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] oslo_messaging_notifications.transport_url = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack quobyte-client[86642]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] key_manager.fixed_key = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack quobyte-client[86642]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.barbican_api_version = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.barbican_endpoint = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.barbican_endpoint_type = public {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.barbican_region_name = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.cafile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86637]: DEBUG oslo_concurrency.processutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] CMD "mount.quobyte" returned: 1 in 0.141s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.certfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.collect_timing = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86637) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.insecure = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86637) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:22 devstack cinder-volume[86637]: DEBUG cinder.volume.drivers.quobyte [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=86637) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.keyfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.number_of_retries = 60 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86637]: INFO cinder.volume.drivers.quobyte [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 ... Nov 04 18:49:22 devstack cinder-volume[86637]: DEBUG oslo_concurrency.processutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 -c /etc/quobyte/client-cinder.cfg {{(pid=86637) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.retry_delay = 1 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.send_service_user_token = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.split_loggers = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.timeout = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.tls_ciphers = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.tls_min_version = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.verify_ssl = True {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican.verify_ssl_path = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican_service_user.auth_section = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican_service_user.auth_type = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican_service_user.cafile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican_service_user.certfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican_service_user.collect_timing = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican_service_user.insecure = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican_service_user.keyfile = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican_service_user.split_loggers = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican_service_user.timeout = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican_service_user.tls_ciphers = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] barbican_service_user.tls_min_version = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.approle_role_id = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.approle_secret_id = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.auth_method = approle {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.auth_path = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.kv_mountpoint = secret {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.kv_path = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.kv_version = 2 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.namespace = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.root_token_id = **** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.ssl_ca_crt_file = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.timeout = 60.0 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.token_file = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.token_role = None {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.use_ssl = False {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack sudo[86651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 -c /etc/quobyte/client-cinder.cfg Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:22 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] ******************************************************************************** {{(pid=86391) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 18:49:22 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:23 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG oslo_concurrency.processutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.524s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:23 devstack cinder-volume[86637]: INFO cinder.volume.drivers.quobyte [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 succeeded Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG cinder.volume.drivers.quobyte [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=86637) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.539s {{(pid=86637) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG oslo_concurrency.processutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:23 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:49:23 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:23 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG oslo_concurrency.processutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.425s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:23 devstack cinder-volume[86637]: INFO cinder.volume.driver [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG cinder.volume.driver [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5831718444824, 'free_capacity_gb': 1773.5831718444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86637) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG oslo_db.sqlalchemy.engines [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86637) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG dbcounter [-] [86637] Writer thread running {{(pid=86637) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG cinder.db.api [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Building query based on filter {{(pid=86637) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG cinder.image.image_utils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86637) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 18:49:23 devstack cinder-volume[86637]: INFO cinder.keymgr.migration [None req-b9109c92-86b6-4584-b25e-73bb44cfc184 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86637) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86637) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG cinder.volume.drivers.quobyte [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=86637) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG cinder.volume.drivers.quobyte [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=86637) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86637) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:23 devstack cinder-volume[86637]: DEBUG oslo_concurrency.processutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:23 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:49:23 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:24 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:24 devstack cinder-volume[86637]: DEBUG oslo_concurrency.processutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.477s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:24 devstack cinder-volume[86637]: DEBUG cinder.manager [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Notifying Schedulers of capabilities ... {{(pid=86637) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:49:24 devstack cinder-volume[86637]: INFO cinder.volume.manager [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Driver initialization completed successfully. Nov 04 18:49:24 devstack cinder-volume[86637]: INFO cinder.manager [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Initiating service 3 cleanup Nov 04 18:49:24 devstack cinder-volume[86637]: INFO cinder.manager [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Service 3 cleanup completed. Nov 04 18:49:24 devstack cinder-volume[86637]: DEBUG cinder.service [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Creating RPC server for service cinder-volume {{(pid=86637) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 18:49:24 devstack cinder-volume[86637]: DEBUG cinder.service [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86637) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 18:49:24 devstack cinder-volume[86637]: INFO cinder.volume.manager [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 18:49:24 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86637) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:24 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86637) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:24 devstack cinder-volume[86637]: DEBUG cinder.volume.drivers.quobyte [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=86637) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:49:24 devstack cinder-volume[86637]: DEBUG cinder.volume.drivers.quobyte [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=86637) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:49:24 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86637) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:24 devstack cinder-volume[86637]: DEBUG oslo_concurrency.processutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=86637) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:24 devstack sudo[86881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:49:24 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:24 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:24 devstack cinder-volume[86637]: DEBUG oslo_concurrency.processutils [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.308s {{(pid=86637) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:24 devstack cinder-volume[86637]: INFO cinder.volume.manager [None req-828f7a4f-690e-4110-a9d5-c07617063406 None None] Driver post RPC initialization completed successfully. Nov 04 18:49:28 devstack cinder-volume[86391]: INFO oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Caught SIGTERM, stopping children Nov 04 18:49:28 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Acquiring lock "singleton_lock" {{(pid=86391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:49:28 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Acquired lock "singleton_lock" {{(pid=86391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:49:28 devstack cinder-volume[86391]: DEBUG oslo_concurrency.lockutils [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Releasing lock "singleton_lock" {{(pid=86391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:49:28 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Stop services. {{(pid=86391) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 04 18:49:28 devstack cinder-volume[86391]: DEBUG oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Killing children. {{(pid=86391) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 04 18:49:28 devstack cinder-volume[86391]: INFO oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Waiting on 1 children to exit Nov 04 18:49:28 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Acquiring lock "singleton_lock" {{(pid=86637) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:49:28 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Acquired lock "singleton_lock" {{(pid=86637) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:49:28 devstack cinder-volume[86637]: DEBUG oslo_concurrency.lockutils [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Releasing lock "singleton_lock" {{(pid=86637) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:49:28 devstack cinder-volume[86637]: WARNING amqp [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:49:28 devstack cinder-volume[86637]: WARNING amqp [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 04 18:49:28 devstack cinder-volume[86391]: INFO oslo_service.backend._eventlet.service [None req-2fad4f52-271a-468c-a53f-722c42671bcb None None] Child 86637 exited with status 0 Nov 04 18:49:29 devstack cinder-volume[87040]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 04 18:49:29 devstack cinder-volume[87040]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 18:49:29 devstack cinder-volume[87040]: we strongly recommend against using it for new projects. Nov 04 18:49:29 devstack cinder-volume[87040]: If you are already using Eventlet, we recommend migrating to a different Nov 04 18:49:29 devstack cinder-volume[87040]: framework. For more detail see Nov 04 18:49:29 devstack cinder-volume[87040]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 18:49:29 devstack cinder-volume[87040]: import eventlet # noqa Nov 04 18:49:33 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87040) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 04 18:49:33 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87040) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 04 18:49:33 devstack cinder-volume[87040]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87040) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 04 18:49:34 devstack cinder-volume[87040]: INFO dbcounter [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Registered counter for database cinder Nov 04 18:49:34 devstack cinder-volume[87040]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87040) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:49:34 devstack cinder-volume[87040]: DEBUG dbcounter [-] [87040] Writer thread running {{(pid=87040) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:49:35 devstack cinder-volume[87040]: INFO cinder.rpc [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 04 18:49:35 devstack cinder-volume[87040]: INFO cinder.rpc [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87040) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:49:35 devstack cinder-volume[87040]: INFO cinder.volume.manager [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Determined volume DB was empty at startup. Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG cinder.volume.manager [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87040) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 04 18:49:35 devstack cinder-volume[87040]: WARNING stevedore.named [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 04 18:49:35 devstack cinder-volume[87040]: WARNING castellan.key_manager [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:49:35 devstack cinder-volume[87040]: WARNING cinder.keymgr.conf_key_mgr [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 04 18:49:35 devstack cinder-volume[87040]: INFO cinder.volume.manager [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87040) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:49:35 devstack cinder-volume[87040]: INFO oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Starting 1 workers Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Started child 87364 {{(pid=87040) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Full set of CONF: {{(pid=87040) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] ******************************************************************************** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] Configuration options gathered from: {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] ================================================================================ {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] allow_availability_zone_fallback = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] allow_compression_on_image_upload = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] allowed_direct_url_schemes = [] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] api_rate_limit = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87364]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] auth_strategy = keystone {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_availability_zone = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_host = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_name = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_stats_polling_interval = 60 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backup_api_class = cinder.backup.api.API {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backup_name_template = backup-%s {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backup_use_same_host = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backup_use_temp_snapshot = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] chap_password = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] chap_username = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cinder_internal_tenant_project_id = eb8c08516430408bafb8f1de4354a6eb {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cinder_internal_tenant_user_id = fd695a65fe2f451d95c9d1af7156f66a {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cluster = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] compression_format = gzip {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] compute_api_class = cinder.compute.nova.API {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] config_dir = [] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] config_source = [] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] control_exchange = openstack {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] debug = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] default_availability_zone = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] default_group_type = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] default_volume_type = QuobyteHD {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] disk_geometry = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] driver_client_cert = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] driver_client_cert_key = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] driver_data_namespace = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] driver_ssl_cert_path = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] driver_ssl_cert_verify = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] driver_use_ssl = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] enable_new_services = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] enable_unsupported_driver = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] enabled_backends = ['QuobyteHD'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] enforce_multipath_for_image_xfer = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] filter_function = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance_api_insecure = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance_api_servers = ['http://192.168.122.120/image'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance_api_ssl_compression = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance_ca_certificates_file = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance_catalog_info = image:glance:publicURL {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance_certfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance_keyfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance_num_retries = 3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance_request_timeout = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] goodness_function = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] graceful_shutdown_timeout = 5 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] group_api_class = cinder.group.api.API {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] host = devstack {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_compress_on_upload = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_conversion_address_space_limit = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_conversion_cpu_limit = 60 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_conversion_disable = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_introspection_address_space_limit = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_introspection_cpu_limit = 60 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_upload_use_cinder_backend = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_upload_use_internal_tenant = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_volume_cache_enabled = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_volume_cache_max_count = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] image_volume_cache_max_size_gb = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] init_host_max_objects_retrieval = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] instance_format = [instance: %(uuid)s] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] iscsi_target_flags = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] iscsi_write_cache = on {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] iser_helper = tgtadm {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] iser_ip_address = 192.168.122.120 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] iser_port = 3260 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] log_color = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] log_config_append = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] log_dir = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] log_file = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] log_options = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] log_rotate_interval = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] log_rotate_interval_type = days {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] log_rotation_type = none {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] max_age = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] max_logfile_count = 30 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] max_logfile_size_mb = 200 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] max_over_subscription_ratio = 20.0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] message_reap_interval = 86400 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] message_ttl = 2592000 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] migration_create_volume_timeout_secs = 300 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] monkey_patch = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] monkey_patch_modules = [] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] my_ip = 192.168.122.120 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] no_snapshot_gb_quota = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] num_iser_scan_tries = 3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] num_shell_tries = 3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] num_volume_device_scan_tries = 3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] nvmeof_conn_info_version = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] nvmet_ns_id = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] nvmet_port_id = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] osapi_max_limit = 1000 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] osapi_volume_ext_list = [] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] osapi_volume_listen_port = 8776 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] osapi_volume_use_ssl = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] osapi_volume_workers = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] per_volume_size_limit = -1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] periodic_fuzzy_delay = 60 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] periodic_interval = 60 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] public_endpoint = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] publish_errors = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] quota_backup_gigabytes = 1000 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] quota_backups = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] quota_gigabytes = 1000 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] quota_groups = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] quota_snapshots = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] quota_volumes = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] rate_limit_burst = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] rate_limit_except_level = CRITICAL {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] rate_limit_interval = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] reinit_driver_count = 3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] replication_device = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] report_discard_supported = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] report_interval = 120 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] reservation_clean_interval = 86400 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] reservation_expire = 86400 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] reserved_image_namespaces = [] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] reserved_percentage = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] rpc_response_timeout = 120 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] run_external_periodic_tasks = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] scst_target_driver = iscsi {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] scst_target_iqn_name = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_down_time = 720 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] shell_completion = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] snapshot_name_template = snapshot-%s {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] split_loggers = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] state_path = /opt/stack/data/cinder {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] storage_availability_zone = nova {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] storage_protocol = iSCSI {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] syslog_log_facility = LOG_USER {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] target_helper = lioadm {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87364) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] target_ip_address = 192.168.122.120 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] target_port = 3260 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] target_protocol = iscsi {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] target_secondary_ip_addresses = [] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] trace_flags = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] transport_url = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] until_refresh = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] use_chap_auth = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] use_default_quota_class = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] use_journal = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] use_json = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] use_multipath_for_image_xfer = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] use_stderr = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] use_syslog = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] verify_glance_signatures = enabled {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_api_class = cinder.volume.api.API {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_backend_name = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_clear = zero {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_clear_ionice = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_clear_size = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_copy_bps_limit = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_dd_blocksize = 1M {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_name_template = volume-%s {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_service_inithost_offload = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volume_usage_audit_period = month {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] zoning_mode = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_concurrency.disable_process_locking = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.auth_section = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.auth_type = password {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.auth_version = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.cache = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.certfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.include_service_catalog = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.insecure = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.interface = public {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.keyfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_password = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcache_username = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.region_name = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.service_type = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.120/identity {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.backend = dogpile.cache.null {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.backend_argument = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.backend_expiration_time = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.config_prefix = cache.oslo {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.debug_cache_backend = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.enable_retry_client = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.enable_socket_keepalive = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.enabled = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.expiration_time = 600 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.hashclient_retry_attempts = 2 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.memcache_dead_retry = 300 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.memcache_pool_maxsize = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.memcache_sasl_enabled = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.password = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.proxies = [] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.redis_db = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.redis_server = localhost:6379 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.retry_attempts = 2 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.retry_delay = 0.0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.socket_keepalive_count = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.socket_keepalive_idle = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.socket_keepalive_interval = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.socket_timeout = 1.0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.tls_allowed_ciphers = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.tls_cafile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.tls_certfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.tls_enabled = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.tls_keyfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cache.username = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] coordination.backend_url = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.asyncio_connection = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.asyncio_slave_connection = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.backend = sqlalchemy {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.connection = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.connection_debug = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.connection_parameters = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.connection_recycle_time = 3600 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.connection_trace = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.db_inc_retry_interval = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.db_max_retries = 20 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.db_max_retry_interval = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.db_retry_interval = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.max_overflow = 50 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.max_pool_size = 5 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.max_retries = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.mysql_wsrep_sync_wait = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.pool_timeout = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.retry_interval = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.slave_connection = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.sqlite_synchronous = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.synchronous_reader = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] database.use_db_reconnect = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_tracing.insecure = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler.connection_string = messaging:// {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler.enabled = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler.es_doc_type = notification {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler.es_scroll_size = 10000 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler.es_scroll_time = 2m {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler.filter_error_trace = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler.hmac_keys = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler.sentinel_service_name = mymaster {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler.socket_timeout = 0.1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler.trace_requests = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler.trace_sqlalchemy = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler_jaeger.process_tags = {} {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler_jaeger.service_name_prefix = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] profiler_otlp.service_name_prefix = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_policy.enforce_new_defaults = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_policy.policy_default_rule = default {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_policy.policy_file = policy.yaml {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] privsep_osbrick.group = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] privsep_osbrick.helper_command = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] privsep_osbrick.user = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cinder_sys_admin.group = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cinder_sys_admin.helper_command = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] cinder_sys_admin.user = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.auth_section = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.auth_type = password {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.cafile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.certfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.collect_timing = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.insecure = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.keyfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87364) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.send_service_user_token = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.split_loggers = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.quobyte [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.timeout = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.quobyte [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.tls_ciphers = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] service_user.tls_min_version = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.auth_section = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.auth_type = password {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Running cmd (subprocess): mount.quobyte {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.certfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.collect_timing = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.insecure = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.keyfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.region_name = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.split_loggers = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.timeout = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.tls_ciphers = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] glance.tls_min_version = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.backend_availability_zone = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.chap_password = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.chap_username = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.disk_geometry = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.driver_client_cert = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.driver_client_cert_key = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.driver_data_namespace = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.driver_use_ssl = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.extra_capabilities = {} {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.filter_function = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.goodness_function = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.iscsi_target_flags = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.iscsi_write_cache = on {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.iser_helper = tgtadm {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.iser_ip_address = 192.168.122.120 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.iser_port = 3260 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nas_host = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nas_login = admin {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nas_mount_options = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nas_password = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nas_private_key = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nas_share_path = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.num_shell_tries = 3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.quobyte_volume_url = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.replication_device = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.report_discard_supported = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.reserved_percentage = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.target_helper = tgtadm {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.target_ip_address = 192.168.122.120 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.target_port = 3260 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.target_protocol = iscsi {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.trace_flags = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.unique_fqdn_network = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.use_chap_auth = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.volume_backend_name = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.volume_clear = zero {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.volume_clear_ionice = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.volume_clear_size = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_reports.file_event_handler = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_reports.log_dir = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.backend_availability_zone = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.backend_host = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.chap_password = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.chap_username = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.chiscsi_conf = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.disk_geometry = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.driver_client_cert = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.driver_data_namespace = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.driver_use_ssl = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.extra_capabilities = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.filter_function = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.goodness_function = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.iser_helper = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.iser_ip_address = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.iser_port = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.iser_target_prefix = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nas_host = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nas_login = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nas_mount_options = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nas_password = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nas_private_key = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nas_share_path = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nas_ssh_port = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.num_shell_tries = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.nvmet_port_id = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.replication_device = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.report_discard_supported = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.reserved_percentage = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.scst_target_driver = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.storage_protocol = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.target_helper = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.target_ip_address = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.target_port = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.target_prefix = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.target_protocol = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.trace_flags = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.use_chap_auth = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.volume_clear = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.volume_clear_size = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] QuobyteHD.volumes_dir = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.ssl = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_notifications.driver = [] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_notifications.retry = -1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] key_manager.fixed_key = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.barbican_api_version = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.barbican_endpoint = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.barbican_endpoint_type = public {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.barbican_region_name = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.cafile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.certfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack quobyte-client[87375]: Reading configuration file: /etc/quobyte/client.cfg Nov 04 18:49:35 devstack quobyte-client[87375]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.collect_timing = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.insecure = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.keyfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.number_of_retries = 60 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.retry_delay = 1 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.send_service_user_token = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.split_loggers = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.timeout = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.tls_ciphers = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.tls_min_version = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.verify_ssl = True {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican.verify_ssl_path = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican_service_user.auth_section = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican_service_user.auth_type = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] CMD "mount.quobyte" returned: 1 in 0.145s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican_service_user.cafile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican_service_user.certfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican_service_user.collect_timing = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican_service_user.insecure = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican_service_user.keyfile = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican_service_user.split_loggers = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican_service_user.timeout = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican_service_user.tls_ciphers = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] barbican_service_user.tls_min_version = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.approle_role_id = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.approle_secret_id = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.auth_method = approle {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.auth_path = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.kv_mountpoint = secret {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.kv_path = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.kv_version = 2 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.namespace = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.root_token_id = **** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.ssl_ca_crt_file = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.timeout = 60.0 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.token_file = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.token_role = None {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.use_ssl = False {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 04 18:49:35 devstack cinder-volume[87040]: DEBUG oslo_service.backend._eventlet.service [None req-f1e6a7a1-5fc0-472b-bafd-cc33d1754598 None None] ******************************************************************************** {{(pid=87040) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 04 18:49:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:49:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:35 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:49:35 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:36 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.334s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:36 devstack cinder-volume[87364]: INFO cinder.volume.driver [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Driver hasn't implemented _init_vendor_properties() Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG cinder.volume.driver [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5831718444824, 'free_capacity_gb': 1773.5831718444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87364) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG oslo_db.sqlalchemy.engines [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87364) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writer thread running {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG cinder.db.api [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Building query based on filter {{(pid=87364) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87364) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:36 devstack cinder-volume[87364]: INFO cinder.keymgr.migration [None req-ec248cf7-4ce3-423b-9c2a-d217bc29c9d6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 04 18:49:36 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:49:36 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:36 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.305s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:49:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Driver initialization completed successfully. Nov 04 18:49:36 devstack cinder-volume[87364]: INFO cinder.manager [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Initiating service 3 cleanup Nov 04 18:49:36 devstack cinder-volume[87364]: INFO cinder.manager [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Service 3 cleanup completed. Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG cinder.service [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Creating RPC server for service cinder-volume {{(pid=87364) start /opt/stack/cinder/cinder/service.py:231}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG cinder.service [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87364) start /opt/stack/cinder/cinder/service.py:237}} Nov 04 18:49:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:49:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:49:36 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:49:36 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:49:37 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Nov 04 18:49:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.289s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:49:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9d1c972e-96ef-4406-864b-cd2e89ae6c36 None None] Driver post RPC initialization completed successfully. Nov 04 18:49:45 devstack cinder-volume[87040]: DEBUG dbcounter [-] [87040] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87040) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:49:46 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=1 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:49:47 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:50:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:50:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 6 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:50:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:50:57 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:50:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Flow 'volume_create_manager' (6adecb25-736c-43fd-bd16-f67e51a0ea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:50:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd405f5-8260-4392-9091-578f50364306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd405f5-8260-4392-9091-578f50364306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-290169331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bdf95f-f880-43a3-873c-e7693fef2a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95f99597bcd4ba486b31b18046a3043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:50:57Z,use_quota=True,user_id='052ef5d84f3c411da221aa168275d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ffac0a-f549-4da3-9033-3f48aeeb898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ffac0a-f549-4da3-9033-3f48aeeb898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba39658-85f6-4fe7-b658-63452b321b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba39658-85f6-4fe7-b658-63452b321b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3bdf95f-f880-43a3-873c-e7693fef2a22', 'volume_name': 'volume-e3bdf95f-f880-43a3-873c-e7693fef2a22', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e0d570-ec2a-407a-9d79-ab4f683fab0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e0d570-ec2a-407a-9d79-ab4f683fab0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5573305c-660e-4266-b0fc-94d37278393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:50:58 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Volume e3bdf95f-f880-43a3-873c-e7693fef2a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3bdf95f-f880-43a3-873c-e7693fef2a22', 'volume_size': 1} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-290169331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bdf95f-f880-43a3-873c-e7693fef2a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95f99597bcd4ba486b31b18046a3043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:50:57Z,use_quota=True,user_id='052ef5d84f3c411da221aa168275d8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Creating volume e3bdf95f-f880-43a3-873c-e7693fef2a22 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:50:58 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:50:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:50:58 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22 1073741824 Nov 04 18:50:58 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:00 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22 1073741824" returned: 0 in 1.960s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:00 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22 Nov 04 18:51:00 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:00 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22" returned: 0 in 0.442s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] <== create_volume: return (2597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:51:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.605s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5573305c-660e-4266-b0fc-94d37278393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3bdf95f-f880-43a3-873c-e7693fef2a22', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9fb516-3848-4413-a291-57541537a39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:00 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Volume volume-e3bdf95f-f880-43a3-873c-e7693fef2a22 (e3bdf95f-f880-43a3-873c-e7693fef2a22): created successfully Nov 04 18:51:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9fb516-3848-4413-a291-57541537a39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Flow 'volume_create_manager' (6adecb25-736c-43fd-bd16-f67e51a0ea8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c883cdee-4c8f-435f-8e33-576fe78e135d tempest-DeleteServersTestJSON-1960604453 None] Created volume successfully. Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Flow 'volume_create_manager' (bfbe4d59-ba59-40bb-a1ab-f40d7f007f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e832165d-389a-4eba-91c9-0c3726af5bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e832165d-389a-4eba-91c9-0c3726af5bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2140362296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1bcb19-aaac-4529-880c-df43ae9a7e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b99091edf8d4a00ae46dac5f2c9a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:03Z,use_quota=True,user_id='59253c6c0c524c6594914c887a6cd30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2012e9f3-da94-4f58-a529-56444290e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2012e9f3-da94-4f58-a529-56444290e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc9fa9e-62c7-4bfb-bed2-51c918f6eafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc9fa9e-62c7-4bfb-bed2-51c918f6eafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e1bcb19-aaac-4529-880c-df43ae9a7e78', 'volume_name': 'volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d917c7cb-f495-4d51-b46d-21c74a885c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d917c7cb-f495-4d51-b46d-21c74a885c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdda3a6-305a-4f3b-934f-56782c330df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:03 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Volume 2e1bcb19-aaac-4529-880c-df43ae9a7e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78', 'volume_size': 1} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2140362296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1bcb19-aaac-4529-880c-df43ae9a7e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b99091edf8d4a00ae46dac5f2c9a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:03Z,use_quota=True,user_id='59253c6c0c524c6594914c887a6cd30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Creating volume 2e1bcb19-aaac-4529-880c-df43ae9a7e78 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:51:03 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:51:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:03 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78 1073741824 Nov 04 18:51:03 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:04 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78 1073741824" returned: 0 in 0.932s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:05 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78 Nov 04 18:51:05 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:05 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78" returned: 0 in 0.584s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:51:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdda3a6-305a-4f3b-934f-56782c330df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a234274a-0805-4620-af23-018481611121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:05 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Volume volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78 (2e1bcb19-aaac-4529-880c-df43ae9a7e78): created successfully Nov 04 18:51:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a234274a-0805-4620-af23-018481611121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Flow 'volume_create_manager' (bfbe4d59-ba59-40bb-a1ab-f40d7f007f59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5d9e44bb-9fae-47a8-b1f0-81c92ddab63d tempest-VolumesAdminNegativeTest-227239549 None] Created volume successfully. Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Acquiring lock "cinder-2e1bcb19-aaac-4529-880c-df43ae9a7e78-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Lock "cinder-2e1bcb19-aaac-4529-880c-df43ae9a7e78-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Acquiring lock "cinder-quobyte-2e1bcb19-aaac-4529-880c-df43ae9a7e78" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Lock "cinder-quobyte-2e1bcb19-aaac-4529-880c-df43ae9a7e78" acquired by "delete_volume" :: waited 0.014s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:07 devstack cinder-volume[87364]: INFO oslo.privsep.daemon [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpe6vqfvej/privsep.sock'] Nov 04 18:51:07 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpe6vqfvej/privsep.sock Nov 04 18:51:07 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Flow 'volume_create_manager' (0d82d736-de09-41a5-b72f-1461e9cfd5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac2c489-81e0-42cf-ac94-f71703154a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac2c489-81e0-42cf-ac94-f71703154a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-176330634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea28b01-a626-4ab3-b2f0-3594a588964e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b715a1afc14912ac6891e84e2aa094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:08Z,use_quota=True,user_id='1ea27a4f6f574f7dac5d16a208b2a7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cac5794-8962-472c-8b95-6c6ed6603f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cac5794-8962-472c-8b95-6c6ed6603f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f25aa1-5a8d-42f3-a06e-6b6e71f0e579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f25aa1-5a8d-42f3-a06e-6b6e71f0e579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea28b01-a626-4ab3-b2f0-3594a588964e', 'volume_name': 'volume-9ea28b01-a626-4ab3-b2f0-3594a588964e', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d2b2b9-0397-4c76-956d-d3a041f37b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d2b2b9-0397-4c76-956d-d3a041f37b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375dbaf0-58a1-4255-bda5-224aa86ddfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:07 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Volume 9ea28b01-a626-4ab3-b2f0-3594a588964e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea28b01-a626-4ab3-b2f0-3594a588964e', 'volume_size': 1} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-176330634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea28b01-a626-4ab3-b2f0-3594a588964e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b715a1afc14912ac6891e84e2aa094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:08Z,use_quota=True,user_id='1ea27a4f6f574f7dac5d16a208b2a7cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Creating volume 9ea28b01-a626-4ab3-b2f0-3594a588964e {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:51:07 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:51:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:07 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e 1073741824 Nov 04 18:51:07 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:08 devstack cinder-volume[87364]: WARNING py.warnings [req-a80ab337-28b8-408d-96b1-7612213fb757 req-107cd9e0-12d4-451f-be82-ba5b802a11c6 tempest-DeleteServersTestJSON-1960604453 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 04 18:51:08 devstack cinder-volume[87364]: .first() Nov 04 18:51:08 devstack cinder-volume[87364]: Nov 04 18:51:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a80ab337-28b8-408d-96b1-7612213fb757 req-107cd9e0-12d4-451f-be82-ba5b802a11c6 tempest-DeleteServersTestJSON-1960604453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:09 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e 1073741824" returned: 0 in 1.143s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:09 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e Nov 04 18:51:09 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:09 devstack cinder-volume[87364]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 04 18:51:09 devstack cinder-volume[87364]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 04 18:51:09 devstack cinder-volume[87364]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 04 18:51:09 devstack cinder-volume[87364]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 18:51:09 devstack cinder-volume[87364]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 04 18:51:09 devstack cinder-volume[87364]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 04 18:51:09 devstack cinder-volume[87364]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 04 18:51:09 devstack cinder-volume[87364]: WARNING oslo.privsep.daemon [-] privsep log: Nov 04 18:51:09 devstack cinder-volume[87364]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 04 18:51:10 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e" returned: 0 in 0.919s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] <== create_volume: return (2182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a80ab337-28b8-408d-96b1-7612213fb757 req-107cd9e0-12d4-451f-be82-ba5b802a11c6 tempest-DeleteServersTestJSON-1960604453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.299s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:10 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:10 devstack cinder-volume[87364]: INFO oslo.privsep.daemon [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Spawned new privsep daemon via rootwrap Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Accepted privsep connection to /tmp/tmpe6vqfvej/privsep.sock {{(pid=87364) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 04 18:51:10 devstack cinder-volume[87364]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 04 18:51:10 devstack cinder-volume[87364]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 04 18:51:10 devstack cinder-volume[87364]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 04 18:51:10 devstack cinder-volume[87364]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88580 Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc149253-4a80-46fd-8bd4-17950cf9ab40]: (2,) {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375dbaf0-58a1-4255-bda5-224aa86ddfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea28b01-a626-4ab3-b2f0-3594a588964e', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5926c65-64fb-49de-a896-5dce53006fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f7cc90-32c3-4e56-b020-4ccbe9984de7]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:10 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Volume volume-9ea28b01-a626-4ab3-b2f0-3594a588964e (9ea28b01-a626-4ab3-b2f0-3594a588964e): created successfully Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5926c65-64fb-49de-a896-5dce53006fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Flow 'volume_create_manager' (0d82d736-de09-41a5-b72f-1461e9cfd5c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a80ab337-28b8-408d-96b1-7612213fb757 req-107cd9e0-12d4-451f-be82-ba5b802a11c6 tempest-DeleteServersTestJSON-1960604453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.520s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:10 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e1bb8475-fd88-4a44-8059-6be65b8afff0 tempest-ServerRescueNegativeTestJSON-861754299 None] Created volume successfully. Nov 04 18:51:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a80ab337-28b8-408d-96b1-7612213fb757 req-107cd9e0-12d4-451f-be82-ba5b802a11c6 tempest-DeleteServersTestJSON-1960604453 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-e3bdf95f-f880-43a3-873c-e7693fef2a22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '194cbf91-d12e-4502-b604-8e0797f4041a', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:51:10 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78 Nov 04 18:51:10 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:11 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-a80ab337-28b8-408d-96b1-7612213fb757 req-107cd9e0-12d4-451f-be82-ba5b802a11c6 tempest-DeleteServersTestJSON-1960604453 None] attachment_update completed successfully. Nov 04 18:51:11 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78" returned: 0 in 1.072s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:11 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78 Nov 04 18:51:11 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:12 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e1bcb19-aaac-4529-880c-df43ae9a7e78" returned: 0 in 0.985s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Lock "cinder-quobyte-2e1bcb19-aaac-4529-880c-df43ae9a7e78" released by "delete_volume" :: held 5.230s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:12 devstack cinder-volume[87364]: WARNING cinder.quota [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:51:12 devstack cinder-volume[87364]: WARNING cinder.quota [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:51:12 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Created reservations ['65afbeb0-8977-4d8c-9322-e03c1b03a814', '6cbd0ab2-bc54-4de7-ab42-35db0d3734af', '49fa2ed3-b254-4e88-81a5-e9182186bea5', '649d491c-b413-441d-81aa-b522556bd632'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:51:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:12 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:51:12 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:13 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.477s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:13 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:51:13 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Deleted volume successfully. Nov 04 18:51:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9373ec11-7957-432e-a0b3-a10f1a1162f4 tempest-VolumesAdminNegativeTest-227239549 None] Lock "cinder-2e1bcb19-aaac-4529-880c-df43ae9a7e78-delete_volume" released by "delete_volume" :: held 6.144s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:16 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:51:16 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:16 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.380s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 8 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:51:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:51:19 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-a990bd80-f575-412b-acf0-cd425aa6b514 req-4d5bbf85-5ad4-4510-a4f3-3337e18e5297 tempest-DeleteServersTestJSON-1960604453 None] Terminate volume connection completed successfully. Nov 04 18:51:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a990bd80-f575-412b-acf0-cd425aa6b514 req-4d5bbf85-5ad4-4510-a4f3-3337e18e5297 tempest-DeleteServersTestJSON-1960604453 None] Deleting attachment 194cbf91-d12e-4502-b604-8e0797f4041a. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:51:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Acquiring lock "cinder-e3bdf95f-f880-43a3-873c-e7693fef2a22-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Lock "cinder-e3bdf95f-f880-43a3-873c-e7693fef2a22-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Acquiring lock "cinder-quobyte-e3bdf95f-f880-43a3-873c-e7693fef2a22" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Lock "cinder-quobyte-e3bdf95f-f880-43a3-873c-e7693fef2a22" acquired by "delete_volume" :: waited 0.052s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:21 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18954e9-d080-40a8-ad89-2a4308e4bc76]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:51:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:21 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22 Nov 04 18:51:21 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:22 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22" returned: 0 in 0.997s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:22 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22 Nov 04 18:51:22 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:23 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e3bdf95f-f880-43a3-873c-e7693fef2a22" returned: 0 in 0.550s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Lock "cinder-quobyte-e3bdf95f-f880-43a3-873c-e7693fef2a22" released by "delete_volume" :: held 1.664s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:23 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Created reservations ['d42c7453-a4f4-4549-829b-0a5fa146be44', 'bd791bcd-7a33-4c97-8268-8d45d1be76b2', 'd9c2901c-00ee-4c35-aecf-890f596ef9fa', '4f8ea87a-5a2b-4cc4-8215-c860e5c33795'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:51:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:23 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:51:23 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:24 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.518s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:24 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:51:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Deleted volume successfully. Nov 04 18:51:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e492033-d160-4f7e-b65b-95c96415eed1 tempest-DeleteServersTestJSON-1960604453 None] Lock "cinder-e3bdf95f-f880-43a3-873c-e7693fef2a22-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:33 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=19,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:51:34 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=28,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=3 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Acquiring lock "cinder-9ea28b01-a626-4ab3-b2f0-3594a588964e-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Lock "cinder-9ea28b01-a626-4ab3-b2f0-3594a588964e-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Acquiring lock "cinder-quobyte-9ea28b01-a626-4ab3-b2f0-3594a588964e" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Lock "cinder-quobyte-9ea28b01-a626-4ab3-b2f0-3594a588964e" acquired by "delete_volume" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1805d9-e97a-411f-8170-aeae5e0cff82]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:40 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e Nov 04 18:51:40 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Flow 'volume_create_manager' (bf84e02b-d951-4687-880a-da6cd61c950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ba63a5-c89e-4588-914f-57c88255622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ba63a5-c89e-4588-914f-57c88255622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1902958781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb89913-64f1-4fb2-82cc-d6dbb81f1a84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b268635e850e4f4a97f3802ae606a9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:41Z,use_quota=True,user_id='79453be56361437aadba4a7b7c5dfe03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b615df6-d8ab-4cf1-b4c5-1d158c4f3a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b615df6-d8ab-4cf1-b4c5-1d158c4f3a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2c5a2f-27fe-4bf8-90ba-e5d0ed54ed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2c5a2f-27fe-4bf8-90ba-e5d0ed54ed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb89913-64f1-4fb2-82cc-d6dbb81f1a84', 'volume_name': 'volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39af2b0b-9dd3-40f1-b69c-0105ecf3502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39af2b0b-9dd3-40f1-b69c-0105ecf3502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c673b0ff-6129-483d-b806-c1d4b160a7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:40 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Volume 6eb89913-64f1-4fb2-82cc-d6dbb81f1a84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84', 'volume_size': 1} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1902958781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb89913-64f1-4fb2-82cc-d6dbb81f1a84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b268635e850e4f4a97f3802ae606a9a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:41Z,use_quota=True,user_id='79453be56361437aadba4a7b7c5dfe03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Creating volume 6eb89913-64f1-4fb2-82cc-d6dbb81f1a84 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:51:40 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:51:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:40 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84 1073741824 Nov 04 18:51:40 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:41 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e" returned: 0 in 0.671s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:41 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e Nov 04 18:51:41 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:41 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84 1073741824" returned: 0 in 0.496s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:41 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9ea28b01-a626-4ab3-b2f0-3594a588964e" returned: 0 in 0.327s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Lock "cinder-quobyte-9ea28b01-a626-4ab3-b2f0-3594a588964e" released by "delete_volume" :: held 1.134s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:41 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84 Nov 04 18:51:41 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Created reservations ['1179dc7b-0133-4383-9a69-169101782e19', '4bc714d3-243d-4982-a75f-328a05ec5716', 'c8a5a198-e799-4390-ad01-b8c0b5beac64', 'c9e55792-3dbc-4cc1-8e0a-299335e75749'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:41 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:51:41 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:41 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84" returned: 0 in 0.471s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:51:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c673b0ff-6129-483d-b806-c1d4b160a7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c6cfce-bdc3-4a58-bf88-c4ac09358ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:42 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Volume volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84 (6eb89913-64f1-4fb2-82cc-d6dbb81f1a84): created successfully Nov 04 18:51:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c6cfce-bdc3-4a58-bf88-c4ac09358ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Flow 'volume_create_manager' (bf84e02b-d951-4687-880a-da6cd61c950e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-a44ebb30-e9d1-4092-8905-143a80e3e8cc req-649b61a5-1e57-4358-bbb2-f66831dbab72 tempest-VolumesGetTestJSON-1700140192 None] Created volume successfully. Nov 04 18:51:42 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.437s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:42 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:51:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Deleted volume successfully. Nov 04 18:51:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3b061a19-0660-4ca7-846f-96da36924096 tempest-ServerRescueNegativeTestJSON-861754299 None] Lock "cinder-9ea28b01-a626-4ab3-b2f0-3594a588964e-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Acquiring lock "cinder-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Lock "cinder-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Acquiring lock "cinder-quobyte-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:51:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Lock "cinder-quobyte-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:51:43 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f712fd-f75a-4f70-92cf-c810f5b279c2]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:51:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:43 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84 Nov 04 18:51:43 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:44 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84" returned: 0 in 0.713s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:44 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84 Nov 04 18:51:44 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:44 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84" returned: 0 in 0.350s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Lock "cinder-quobyte-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84" released by "delete_volume" :: held 1.177s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:44 devstack cinder-volume[87364]: DEBUG cinder.quota [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Created reservations ['4b7a1136-e78c-484b-b306-5c78bdc65c1e', '5a4c9fc1-85e3-4829-afcf-c8fb0fa5972f', '75e0583a-1e4a-4ac9-948e-94c614e6d032', '2faa76c3-9365-4da3-8e63-2cc9c2a5011c'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:51:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:44 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:51:44 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:45 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.497s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:45 devstack cinder-volume[87364]: DEBUG cinder.manager [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:51:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Deleted volume successfully. Nov 04 18:51:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-24c289f4-f29a-4000-b9b6-329091a62e29 req-de669981-77c5-4ea3-a119-ce70cfade12a tempest-VolumesGetTestJSON-1700140192 None] Lock "cinder-6eb89913-64f1-4fb2-82cc-d6dbb81f1a84-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Flow 'volume_create_manager' (5632bb7e-caa0-4569-9a17-8c76590f5277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fdf6bf-3ca9-4bb6-8a5c-0e80e9477dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fdf6bf-3ca9-4bb6-8a5c-0e80e9477dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-35787838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ee32fa-b632-4361-8c6e-6c46677a68e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d3fe6f51fee4f38be515eeb8ac1d23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:54Z,use_quota=True,user_id='381a0d0897ea4f31b12c876c3af8231e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d1efd4-2b52-47d0-8679-ab565076bcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d1efd4-2b52-47d0-8679-ab565076bcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c38095-66f0-4dcb-89f7-af62f5a801c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c38095-66f0-4dcb-89f7-af62f5a801c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ee32fa-b632-4361-8c6e-6c46677a68e3', 'volume_name': 'volume-34ee32fa-b632-4361-8c6e-6c46677a68e3', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52deb29a-d866-4275-84a2-c883b32ccb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52deb29a-d866-4275-84a2-c883b32ccb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d0ea46-a6cc-462d-bf79-6e1216dbd837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:54 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Volume 34ee32fa-b632-4361-8c6e-6c46677a68e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ee32fa-b632-4361-8c6e-6c46677a68e3', 'volume_size': 1} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-35787838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ee32fa-b632-4361-8c6e-6c46677a68e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d3fe6f51fee4f38be515eeb8ac1d23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:54Z,use_quota=True,user_id='381a0d0897ea4f31b12c876c3af8231e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Creating volume 34ee32fa-b632-4361-8c6e-6c46677a68e3 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:51:54 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:54 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3 1073741824 Nov 04 18:51:54 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:54 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3 1073741824" returned: 0 in 0.581s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:54 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3 Nov 04 18:51:54 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:55 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3" returned: 0 in 0.333s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:51:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d0ea46-a6cc-462d-bf79-6e1216dbd837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ee32fa-b632-4361-8c6e-6c46677a68e3', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d758cbc-ebe0-426e-b04c-29c50800f54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:55 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Volume volume-34ee32fa-b632-4361-8c6e-6c46677a68e3 (34ee32fa-b632-4361-8c6e-6c46677a68e3): created successfully Nov 04 18:51:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d758cbc-ebe0-426e-b04c-29c50800f54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Flow 'volume_create_manager' (5632bb7e-caa0-4569-9a17-8c76590f5277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:55 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5d2e26ce-4d6d-4b05-b16a-de88864d0363 tempest-VolumesTestJSON-738701871 None] Created volume successfully. Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Flow 'volume_create_manager' (c27dc6a9-0402-4365-949b-908d1d3eb4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb10828-ca8d-4b26-9355-2ca3558b20ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb10828-ca8d-4b26-9355-2ca3558b20ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-413615826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d299d3-20ad-4574-a090-fead6aa2c32b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d3fe6f51fee4f38be515eeb8ac1d23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:57Z,use_quota=True,user_id='381a0d0897ea4f31b12c876c3af8231e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036ce3cc-a0d0-40f4-b94c-47fbcb9c6adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036ce3cc-a0d0-40f4-b94c-47fbcb9c6adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd33168-5acf-41fa-96b0-d26d6d81240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd33168-5acf-41fa-96b0-d26d6d81240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d299d3-20ad-4574-a090-fead6aa2c32b', 'volume_name': 'volume-26d299d3-20ad-4574-a090-fead6aa2c32b', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435a4e78-febc-42ed-89c8-5abba34fe2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435a4e78-febc-42ed-89c8-5abba34fe2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051bf457-d274-4887-9396-17c8c9fd3d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:56 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Volume 26d299d3-20ad-4574-a090-fead6aa2c32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d299d3-20ad-4574-a090-fead6aa2c32b', 'volume_size': 1} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-413615826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d299d3-20ad-4574-a090-fead6aa2c32b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d3fe6f51fee4f38be515eeb8ac1d23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:51:57Z,use_quota=True,user_id='381a0d0897ea4f31b12c876c3af8231e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Creating volume 26d299d3-20ad-4574-a090-fead6aa2c32b {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:51:56 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:51:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:56 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b 1073741824 Nov 04 18:51:56 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:57 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b 1073741824" returned: 0 in 0.490s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:51:57 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b Nov 04 18:51:57 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:51:57 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Nov 04 18:51:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b" returned: 0 in 0.248s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:51:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:51:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:51:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051bf457-d274-4887-9396-17c8c9fd3d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d299d3-20ad-4574-a090-fead6aa2c32b', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204b747-b2a0-4fd9-88c1-29cbb1aa180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:57 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Volume volume-26d299d3-20ad-4574-a090-fead6aa2c32b (26d299d3-20ad-4574-a090-fead6aa2c32b): created successfully Nov 04 18:51:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204b747-b2a0-4fd9-88c1-29cbb1aa180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Flow 'volume_create_manager' (c27dc6a9-0402-4365-949b-908d1d3eb4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-06f45763-c416-4e04-b997-e40335f8e151 tempest-VolumesTestJSON-738701871 None] Created volume successfully. Nov 04 18:51:59 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:51:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Flow 'volume_create_manager' (ad2524b8-2704-4c4a-9c79-a482e8c5a240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:51:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a555a27-9cdf-4bae-95f8-f86d3bf50ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a555a27-9cdf-4bae-95f8-f86d3bf50ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1511075363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02438172-c5f9-4902-a6f3-d365645c5668,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d3fe6f51fee4f38be515eeb8ac1d23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:00Z,use_quota=True,user_id='381a0d0897ea4f31b12c876c3af8231e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954b4d13-9951-4b09-ad4f-f8ee3168f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954b4d13-9951-4b09-ad4f-f8ee3168f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de87c318-8b8b-47df-8381-d826cb192585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de87c318-8b8b-47df-8381-d826cb192585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02438172-c5f9-4902-a6f3-d365645c5668', 'volume_name': 'volume-02438172-c5f9-4902-a6f3-d365645c5668', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad67d7b-4a9d-4093-9f8e-dc58bb5986c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad67d7b-4a9d-4093-9f8e-dc58bb5986c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:51:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e1ee9ea-5168-4a8e-b3c5-b407b1b48c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:51:59 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Volume 02438172-c5f9-4902-a6f3-d365645c5668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02438172-c5f9-4902-a6f3-d365645c5668', 'volume_size': 1} Nov 04 18:52:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1511075363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02438172-c5f9-4902-a6f3-d365645c5668,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d3fe6f51fee4f38be515eeb8ac1d23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:00Z,use_quota=True,user_id='381a0d0897ea4f31b12c876c3af8231e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Creating volume 02438172-c5f9-4902-a6f3-d365645c5668 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:00 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:52:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:00 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668 1073741824 Nov 04 18:52:00 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:00 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668 1073741824" returned: 0 in 0.978s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:01 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668 Nov 04 18:52:01 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:01 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668" returned: 0 in 0.457s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e1ee9ea-5168-4a8e-b3c5-b407b1b48c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02438172-c5f9-4902-a6f3-d365645c5668', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9344c40-0927-4941-a41d-e384feb8847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:01 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Volume volume-02438172-c5f9-4902-a6f3-d365645c5668 (02438172-c5f9-4902-a6f3-d365645c5668): created successfully Nov 04 18:52:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9344c40-0927-4941-a41d-e384feb8847b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Flow 'volume_create_manager' (ad2524b8-2704-4c4a-9c79-a482e8c5a240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a5dd0e4e-c9e6-46f3-9d0a-051e85350ecd tempest-VolumesTestJSON-738701871 None] Created volume successfully. Nov 04 18:52:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Acquiring lock "cinder-02438172-c5f9-4902-a6f3-d365645c5668-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Lock "cinder-02438172-c5f9-4902-a6f3-d365645c5668-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Acquiring lock "cinder-quobyte-02438172-c5f9-4902-a6f3-d365645c5668" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Lock "cinder-quobyte-02438172-c5f9-4902-a6f3-d365645c5668" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:04 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5157157f-374b-4715-b011-90a8cbd8006e]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:04 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668 Nov 04 18:52:04 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:04 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668" returned: 0 in 0.563s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:04 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668 Nov 04 18:52:04 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:05 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02438172-c5f9-4902-a6f3-d365645c5668" returned: 0 in 0.363s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Lock "cinder-quobyte-02438172-c5f9-4902-a6f3-d365645c5668" released by "delete_volume" :: held 1.007s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Created reservations ['d3148559-cea6-41fc-ac38-c23f95a6994f', '18fe033f-60e1-462b-a4ce-f13e4f8eecc4', '7185bb59-2d96-4028-abce-598b9e844a8c', 'f45902d9-f1d6-4f3c-97bb-d9fee9f05cda'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:05 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:52:05 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:05 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.431s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Deleted volume successfully. Nov 04 18:52:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e15f1b29-686e-4a3d-bbda-8d3f037a1ffa tempest-VolumesTestJSON-738701871 None] Lock "cinder-02438172-c5f9-4902-a6f3-d365645c5668-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Acquiring lock "cinder-26d299d3-20ad-4574-a090-fead6aa2c32b-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Lock "cinder-26d299d3-20ad-4574-a090-fead6aa2c32b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Acquiring lock "cinder-quobyte-26d299d3-20ad-4574-a090-fead6aa2c32b" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Lock "cinder-quobyte-26d299d3-20ad-4574-a090-fead6aa2c32b" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:06 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4f3cc2-83c7-485c-b98b-7a1c9759f733]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:06 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b Nov 04 18:52:06 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:07 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b" returned: 0 in 0.438s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:07 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b Nov 04 18:52:07 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:07 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-26d299d3-20ad-4574-a090-fead6aa2c32b" returned: 0 in 0.357s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Lock "cinder-quobyte-26d299d3-20ad-4574-a090-fead6aa2c32b" released by "delete_volume" :: held 0.860s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Created reservations ['edc6de6e-950b-430f-9445-433268847e94', '3e0b55b1-d2f0-433f-ba96-8834c9160b76', '42421814-3346-4fa1-b7bf-a5d4ce7f79cb', 'f786120d-e132-4eb3-98a1-0e4ec82df983'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:07 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:52:07 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Acquiring lock "cinder-34ee32fa-b632-4361-8c6e-6c46677a68e3-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Lock "cinder-34ee32fa-b632-4361-8c6e-6c46677a68e3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Acquiring lock "cinder-quobyte-34ee32fa-b632-4361-8c6e-6c46677a68e3" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Lock "cinder-quobyte-34ee32fa-b632-4361-8c6e-6c46677a68e3" acquired by "delete_volume" :: waited 0.029s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e47dff-49f5-4cbf-a2ce-7145607e209c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:08 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.444s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:08 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3 Nov 04 18:52:08 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Deleted volume successfully. Nov 04 18:52:08 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3275064a-8480-4353-a2ea-66e3a33b1676 tempest-VolumesTestJSON-738701871 None] Lock "cinder-26d299d3-20ad-4574-a090-fead6aa2c32b-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:08 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3" returned: 0 in 0.508s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:08 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3 Nov 04 18:52:08 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:08 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-34ee32fa-b632-4361-8c6e-6c46677a68e3" returned: 0 in 0.328s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Lock "cinder-quobyte-34ee32fa-b632-4361-8c6e-6c46677a68e3" released by "delete_volume" :: held 0.906s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Created reservations ['59472651-01e5-44ef-b60c-5c636f40972a', '1b1e608b-316d-4775-864b-23ab46d1da30', 'fdfe7c22-d64a-447d-8a3f-e719302716a1', '4020ffaf-c0bd-483e-9a3b-df8afcfecbaa'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:08 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:52:08 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:09 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.318s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:09 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:09 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Deleted volume successfully. Nov 04 18:52:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c91a91c9-1532-4c1b-8d8f-bbdb7064581f tempest-VolumesTestJSON-738701871 None] Lock "cinder-34ee32fa-b632-4361-8c6e-6c46677a68e3-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:16 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:52:16 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:16 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.486s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 8 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:52:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:52:18 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=36,cinder:INSERT=10,cinder:UPDATE=47,cinder:DELETE=4 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:52:19 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=58,cinder:SELECT=31,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Flow 'volume_create_manager' (e66b09da-2868-4728-a5f7-6fc327835660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f00b8e-4395-475c-9544-cde26ce2a69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f00b8e-4395-475c-9544-cde26ce2a69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1902251318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a778bf-ad42-4c7d-a5b2-d66f20a4ee48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ba90645d6c428a97812dafd6470d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:35Z,use_quota=True,user_id='20f592b5e90d4049b47e24fd96bd7631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c65172-a94f-4ee4-927d-81a91d3369eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c65172-a94f-4ee4-927d-81a91d3369eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546d31ba-5423-4a07-bcdf-d4422f43298b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546d31ba-5423-4a07-bcdf-d4422f43298b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a778bf-ad42-4c7d-a5b2-d66f20a4ee48', 'volume_name': 'volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564daead-e2a0-4d13-80ef-f12ccbf7ddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564daead-e2a0-4d13-80ef-f12ccbf7ddc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8df350f-d745-4f26-8710-d474b0965c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:35 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Volume 40a778bf-ad42-4c7d-a5b2-d66f20a4ee48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48', 'volume_size': 1} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1902251318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a778bf-ad42-4c7d-a5b2-d66f20a4ee48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ba90645d6c428a97812dafd6470d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:35Z,use_quota=True,user_id='20f592b5e90d4049b47e24fd96bd7631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Creating volume 40a778bf-ad42-4c7d-a5b2-d66f20a4ee48 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:35 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:52:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:35 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48 1073741824 Nov 04 18:52:35 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:36 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48 1073741824" returned: 0 in 0.946s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:36 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48 Nov 04 18:52:36 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:36 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48" returned: 0 in 0.366s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8df350f-d745-4f26-8710-d474b0965c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d53b584-770f-4518-9bd5-238c14647c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:36 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Volume volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48 (40a778bf-ad42-4c7d-a5b2-d66f20a4ee48): created successfully Nov 04 18:52:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d53b584-770f-4518-9bd5-238c14647c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Flow 'volume_create_manager' (e66b09da-2868-4728-a5f7-6fc327835660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-bc9489a9-d0f2-4f9e-9c12-4bd953cde86c tempest-TaggedAttachmentsTest-1998005791 None] Created volume successfully. Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Flow 'volume_create_manager' (d1e93252-5450-47ad-9631-a42d951b73ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bed402-5f72-40f7-8bb4-de740f29b809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bed402-5f72-40f7-8bb4-de740f29b809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-965242683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15077b6-12f0-4631-9aa0-df21c16d7aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a9354e85024d7595025cf6607ec10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:41Z,use_quota=True,user_id='2bb429ddf7084c69b020bc1714359536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2232b9-28ed-450a-88de-b96cef2d501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2232b9-28ed-450a-88de-b96cef2d501b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c1f20f-8c2e-4f3a-ab50-772865e7c418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c1f20f-8c2e-4f3a-ab50-772865e7c418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15077b6-12f0-4631-9aa0-df21c16d7aef', 'volume_name': 'volume-a15077b6-12f0-4631-9aa0-df21c16d7aef', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded59cdb-4e40-4689-b5e1-57785c31cd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded59cdb-4e40-4689-b5e1-57785c31cd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341fd3af-61b4-425d-8543-f63e2d29b8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:41 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Volume a15077b6-12f0-4631-9aa0-df21c16d7aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15077b6-12f0-4631-9aa0-df21c16d7aef', 'volume_size': 1} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-965242683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15077b6-12f0-4631-9aa0-df21c16d7aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a9354e85024d7595025cf6607ec10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:41Z,use_quota=True,user_id='2bb429ddf7084c69b020bc1714359536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Creating volume a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:41 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:52:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:41 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef 1073741824 Nov 04 18:52:41 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:42 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef 1073741824" returned: 0 in 0.736s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:42 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef Nov 04 18:52:42 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:42 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef" returned: 0 in 0.476s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341fd3af-61b4-425d-8543-f63e2d29b8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15077b6-12f0-4631-9aa0-df21c16d7aef', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c33f6bc-9f8f-43ce-820c-96d51a1773f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:42 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Volume volume-a15077b6-12f0-4631-9aa0-df21c16d7aef (a15077b6-12f0-4631-9aa0-df21c16d7aef): created successfully Nov 04 18:52:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c33f6bc-9f8f-43ce-820c-96d51a1773f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Flow 'volume_create_manager' (d1e93252-5450-47ad-9631-a42d951b73ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-15032556-ea53-417f-b32c-0200b4c88965 tempest-SnapshotsActionsTest-1574537170 None] Created volume successfully. Nov 04 18:52:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] Creating offline snapshot 7e38b6e4-9aee-4540-a5ab-72e5a9648a13 of volume a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:52:44 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cc6ca2-184f-4472-a791-3da0ec69d1c8]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:44 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef Nov 04 18:52:44 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:45 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef" returned: 0 in 0.992s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:45 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 1G Nov 04 18:52:45 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:46 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 1G" returned: 0 in 0.968s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:46 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:52:46 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:46 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.444s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:46 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 is being set with open permissions: ugo+rw Nov 04 18:52:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:47 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:52:47 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:47 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.560s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:47 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.info Nov 04 18:52:47 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Flow 'volume_create_manager' (06655932-bbd8-459f-bc6a-bda00d0e703e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbaa7ac-0dac-4791-ad75-7c10d62c6088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:48 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.info" returned: 0 in 0.651s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:48 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.info is being set with open permissions: ugo+rw Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:48 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.info Nov 04 18:52:48 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbaa7ac-0dac-4791-ad75-7c10d62c6088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-517734447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc672c3-9163-47c9-8450-bd3ab5781e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9390e9ef0f48a1ad4505b216cbae31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:48Z,use_quota=True,user_id='07cdebf3400f448eb5572668a0734d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6e8baa-a618-498f-b184-f3a35addca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6e8baa-a618-498f-b184-f3a35addca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7109e3fd-f788-4dc9-a2d2-8a842bf20378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7109e3fd-f788-4dc9-a2d2-8a842bf20378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc672c3-9163-47c9-8450-bd3ab5781e23', 'volume_name': 'volume-6cc672c3-9163-47c9-8450-bd3ab5781e23', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e68866f-37b0-452d-b72b-6b078082ac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e68866f-37b0-452d-b72b-6b078082ac20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7c371b-5a5f-4959-bf45-908e02be875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:48 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Volume 6cc672c3-9163-47c9-8450-bd3ab5781e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc672c3-9163-47c9-8450-bd3ab5781e23', 'volume_size': 1} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:48 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.info" returned: 0 in 0.361s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.196s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.280s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-517734447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc672c3-9163-47c9-8450-bd3ab5781e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9390e9ef0f48a1ad4505b216cbae31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:48Z,use_quota=True,user_id='07cdebf3400f448eb5572668a0734d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Creating volume 6cc672c3-9163-47c9-8450-bd3ab5781e23 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:48 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:52:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:48 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23 1073741824 Nov 04 18:52:48 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:48 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-be0b5a15-9890-4056-b1fe-9b00b173b9d3 tempest-SnapshotsActionsTest-1574537170 None] Create snapshot completed successfully Nov 04 18:52:49 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23 1073741824" returned: 0 in 0.923s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:49 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23 Nov 04 18:52:49 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:50 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23" returned: 0 in 0.506s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] Creating offline snapshot a92e1026-9a40-46fa-ae6b-8e721b40fa7f of volume a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7c371b-5a5f-4959-bf45-908e02be875b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc672c3-9163-47c9-8450-bd3ab5781e23', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16cd8d4-5327-4654-844f-f08e4e04c523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5c0b15-68e5-48a9-8952-6380871f17bd]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:50 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Volume volume-6cc672c3-9163-47c9-8450-bd3ab5781e23 (6cc672c3-9163-47c9-8450-bd3ab5781e23): created successfully Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16cd8d4-5327-4654-844f-f08e4e04c523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Flow 'volume_create_manager' (06655932-bbd8-459f-bc6a-bda00d0e703e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:50 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b98fc8b8-5bfd-495b-bfa2-6d324e3d6c14 tempest-ServersNegativeTestJSON-1197754063 None] Created volume successfully. Nov 04 18:52:50 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:52:50 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:51 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.701s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:51 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f 1G Nov 04 18:52:51 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:51 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f 1G" returned: 0 in 0.743s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:51 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f Nov 04 18:52:51 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:52 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f" returned: 0 in 0.501s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:52 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f is being set with open permissions: ugo+rw Nov 04 18:52:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:52 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f Nov 04 18:52:52 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:52 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f" returned: 0 in 0.511s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:52 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a27ee004-48d4-4c10-9cab-d59a035d4949 tempest-SnapshotsActionsTest-1574537170 None] Create snapshot completed successfully Nov 04 18:52:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-a92e1026-9a40-46fa-ae6b-8e721b40fa7f-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-a92e1026-9a40-46fa-ae6b-8e721b40fa7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-quobyte-a92e1026-9a40-46fa-ae6b-8e721b40fa7f" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-a92e1026-9a40-46fa-ae6b-8e721b40fa7f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Deleting offline snapshot a92e1026-9a40-46fa-ae6b-8e721b40fa7f of volume a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:52:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] snapshot_file for this snap is: volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:52:53 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ecb222-d869-41b2-a5ff-8bda11122339]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Flow 'volume_create_manager' (ab6b872d-e438-4cad-bfbb-5c584c099655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503bcb65-718b-4754-9de7-2d0100814db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503bcb65-718b-4754-9de7-2d0100814db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-309612250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10410c35-9c0c-4900-b247-46f3c2dca74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9390e9ef0f48a1ad4505b216cbae31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:54Z,use_quota=True,user_id='07cdebf3400f448eb5572668a0734d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:54 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660445ce-0e63-4761-b67e-33cdf34268bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660445ce-0e63-4761-b67e-33cdf34268bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1e20f7-9fcf-4838-8b26-481b1893a5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1e20f7-9fcf-4838-8b26-481b1893a5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10410c35-9c0c-4900-b247-46f3c2dca74b', 'volume_name': 'volume-10410c35-9c0c-4900-b247-46f3c2dca74b', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0968f9e2-6930-4512-81bc-8c9b1ee80c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0968f9e2-6930-4512-81bc-8c9b1ee80c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc096b28-c0ad-4675-afb1-d3cc967de794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:54 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Volume 10410c35-9c0c-4900-b247-46f3c2dca74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10410c35-9c0c-4900-b247-46f3c2dca74b', 'volume_size': 1} Nov 04 18:52:54 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-309612250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10410c35-9c0c-4900-b247-46f3c2dca74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9390e9ef0f48a1ad4505b216cbae31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:52:54Z,use_quota=True,user_id='07cdebf3400f448eb5572668a0734d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Creating volume 10410c35-9c0c-4900-b247-46f3c2dca74b {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:52:54 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:52:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:54 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b 1073741824 Nov 04 18:52:54 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:55 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f" returned: 0 in 1.315s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:55 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[268181c3-aa79-4a85-a346-2b617b3c48cd]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:55 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:52:55 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:55 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b 1073741824" returned: 0 in 1.401s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:55 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b Nov 04 18:52:55 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:56 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.825s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:56 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b" returned: 0 in 0.445s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:56 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f Nov 04 18:52:56 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc096b28-c0ad-4675-afb1-d3cc967de794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10410c35-9c0c-4900-b247-46f3c2dca74b', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07263c17-8b66-4adf-b7e1-af043b6d1b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:52:56 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Volume volume-10410c35-9c0c-4900-b247-46f3c2dca74b (10410c35-9c0c-4900-b247-46f3c2dca74b): created successfully Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07263c17-8b66-4adf-b7e1-af043b6d1b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Flow 'volume_create_manager' (ab6b872d-e438-4cad-bfbb-5c584c099655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:52:56 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-cee56bbd-354d-4806-8ea0-c60914fcdd3f tempest-ServersNegativeTestJSON-1197754063 None] Created volume successfully. Nov 04 18:52:56 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f" returned: 0 in 0.645s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:56 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f Nov 04 18:52:56 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:57 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.a92e1026-9a40-46fa-ae6b-8e721b40fa7f" returned: 0 in 0.301s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-a92e1026-9a40-46fa-ae6b-8e721b40fa7f" released by "_delete_snapshot" :: held 3.277s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" released by "delete_snapshot" :: held 3.311s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:57 devstack cinder-volume[87364]: WARNING cinder.quota [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:52:57 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Created reservations ['7f411d18-7679-4c43-912e-89b82b2b9bff', 'ef650f7d-9968-4cb9-ba22-9eb98bb197c5', 'ef92fedb-2eda-45c2-990d-e4bf60881609', '0ce3cadb-47da-428b-bef1-d1b28d8d378e'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Delete snapshot completed successfully. Nov 04 18:52:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e8ade113-4f0f-437f-ba83-88589da6934a tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-a92e1026-9a40-46fa-ae6b-8e721b40fa7f-delete_snapshot" released by "delete_snapshot" :: held 3.566s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Acquiring lock "cinder-10410c35-9c0c-4900-b247-46f3c2dca74b-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Lock "cinder-10410c35-9c0c-4900-b247-46f3c2dca74b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Acquiring lock "cinder-quobyte-10410c35-9c0c-4900-b247-46f3c2dca74b" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:52:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Lock "cinder-quobyte-10410c35-9c0c-4900-b247-46f3c2dca74b" acquired by "delete_volume" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:52:58 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5117dbcb-e087-4dd8-b4aa-8e9a22bf1513]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:58 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b Nov 04 18:52:58 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] Creating offline snapshot f8a02c27-d9e9-4e9a-8045-28964d8b0af1 of volume a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89932b9-a9aa-4c29-81f6-740e642b7466]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:59 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b" returned: 0 in 0.771s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:59 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b Nov 04 18:52:59 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:59 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:52:59 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:59 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10410c35-9c0c-4900-b247-46f3c2dca74b" returned: 0 in 0.467s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Lock "cinder-quobyte-10410c35-9c0c-4900-b247-46f3c2dca74b" released by "delete_volume" :: held 1.354s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Created reservations ['8c83c6d7-ca54-4f33-82e4-e975ce136043', 'faba3885-b54b-403d-8092-9c79afe1fae3', '28ff3b95-9f18-4203-99b9-3508ef4a22e0', '39aa53b7-f993-4b49-bccd-43409d3566ef'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:52:59 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.711s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:52:59 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 1G Nov 04 18:52:59 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:52:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:52:59 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:52:59 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:00 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.434s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:00 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:00 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Deleted volume successfully. Nov 04 18:53:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-41d0c895-e7a2-4cf2-adef-e5436d82f711 tempest-ServersNegativeTestJSON-1197754063 None] Lock "cinder-10410c35-9c0c-4900-b247-46f3c2dca74b-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:00 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 1G" returned: 0 in 0.682s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:00 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 Nov 04 18:53:00 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Acquiring lock "cinder-6cc672c3-9163-47c9-8450-bd3ab5781e23-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Lock "cinder-6cc672c3-9163-47c9-8450-bd3ab5781e23-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Acquiring lock "cinder-quobyte-6cc672c3-9163-47c9-8450-bd3ab5781e23" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Lock "cinder-quobyte-6cc672c3-9163-47c9-8450-bd3ab5781e23" acquired by "delete_volume" :: waited 0.038s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:00 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba78b8d-4ea0-46f1-bded-85b800b7f8d8]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:00 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23 Nov 04 18:53:00 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:01 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1" returned: 0 in 0.595s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:01 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 is being set with open permissions: ugo+rw Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:01 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 Nov 04 18:53:01 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:01 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23" returned: 0 in 0.477s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:01 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23 Nov 04 18:53:01 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:01 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1" returned: 0 in 0.294s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-beadb018-e864-4b7e-89f0-13ea97af020c tempest-SnapshotsActionsTest-1574537170 None] Create snapshot completed successfully Nov 04 18:53:01 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6cc672c3-9163-47c9-8450-bd3ab5781e23" returned: 0 in 0.273s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Lock "cinder-quobyte-6cc672c3-9163-47c9-8450-bd3ab5781e23" released by "delete_volume" :: held 0.858s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Created reservations ['a138b502-4f3e-4ff0-b878-128c2bf6e1f0', '777f1a6a-94fb-49b6-9f79-f2abf8b5eab4', 'aa096c24-c097-42bc-b9ca-f380b3f67ebc', 'c761e00d-4aab-4f28-a1e4-d02080b31949'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:01 devstack sudo[90118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:53:01 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:01 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.292s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:01 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Deleted volume successfully. Nov 04 18:53:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92216386-239d-4eec-a561-0ee3ba8032e2 tempest-ServersNegativeTestJSON-1197754063 None] Lock "cinder-6cc672c3-9163-47c9-8450-bd3ab5781e23-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-f8a02c27-d9e9-4e9a-8045-28964d8b0af1-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-f8a02c27-d9e9-4e9a-8045-28964d8b0af1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-quobyte-f8a02c27-d9e9-4e9a-8045-28964d8b0af1" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-f8a02c27-d9e9-4e9a-8045-28964d8b0af1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Deleting offline snapshot f8a02c27-d9e9-4e9a-8045-28964d8b0af1 of volume a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:53:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] snapshot_file for this snap is: volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:53:02 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e85e5b8-7c03-44fe-b376-330dd745c239]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:02 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 Nov 04 18:53:02 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:03 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1" returned: 0 in 0.710s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:53:03 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed7f92d-90c9-46ad-8122-31bad3e4122f]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:03 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:53:03 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:03 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.533s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:53:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:03 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 Nov 04 18:53:03 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:04 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1" returned: 0 in 0.594s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:04 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1 Nov 04 18:53:04 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:04 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.f8a02c27-d9e9-4e9a-8045-28964d8b0af1" returned: 0 in 0.383s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-f8a02c27-d9e9-4e9a-8045-28964d8b0af1" released by "_delete_snapshot" :: held 2.376s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" released by "delete_snapshot" :: held 2.406s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:04 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Created reservations ['79441098-b5bc-4810-86e7-4901851fc7a3', 'a3e51d6b-b632-44b9-8480-52cccc7bc8b7', 'a1f8284a-bf45-40ad-a8e6-931336ea600c', '935969ad-f84e-48c4-9c57-f49e01d5279a'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:04 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Delete snapshot completed successfully. Nov 04 18:53:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6efa7160-d0d9-466f-aae2-b9fc095d6918 tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-f8a02c27-d9e9-4e9a-8045-28964d8b0af1-delete_snapshot" released by "delete_snapshot" :: held 2.658s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] Creating offline snapshot 8521b241-e937-4a9e-9ca2-44203a3658e5 of volume a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:53:06 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a516310-7044-4b5f-80f0-4f26ace99691]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:06 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:53:06 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:06 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.475s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:53:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:06 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 1G Nov 04 18:53:06 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:07 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 1G" returned: 0 in 0.555s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:07 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 Nov 04 18:53:07 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:07 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5" returned: 0 in 0.298s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:07 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 is being set with open permissions: ugo+rw Nov 04 18:53:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:07 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 Nov 04 18:53:07 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:07 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5" returned: 0 in 0.297s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.753s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:07 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-323ecfa3-f250-40d9-a5b6-1739f0495773 tempest-SnapshotsActionsTest-1574537170 None] Create snapshot completed successfully Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-8521b241-e937-4a9e-9ca2-44203a3658e5-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-8521b241-e937-4a9e-9ca2-44203a3658e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-quobyte-8521b241-e937-4a9e-9ca2-44203a3658e5" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-8521b241-e937-4a9e-9ca2-44203a3658e5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Deleting offline snapshot 8521b241-e937-4a9e-9ca2-44203a3658e5 of volume a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] snapshot_file for this snap is: volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8819e79-b7d1-436f-ba40-4d47461cf334]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:08 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 Nov 04 18:53:08 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:08 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5" returned: 0 in 0.370s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa99d44f-8438-4539-b825-269f1fd2d033]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:09 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:53:09 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:09 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.489s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:09 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:53:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:09 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 Nov 04 18:53:09 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:09 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5" returned: 0 in 0.422s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:09 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5 Nov 04 18:53:09 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:10 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.8521b241-e937-4a9e-9ca2-44203a3658e5" returned: 0 in 0.302s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-8521b241-e937-4a9e-9ca2-44203a3658e5" released by "_delete_snapshot" :: held 1.709s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" released by "delete_snapshot" :: held 1.737s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:10 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Created reservations ['c773fe1f-c62d-48f0-84f2-23cc88944cc5', '558b9215-6720-4fdf-acb9-c303f86777fb', '5362ab67-dbda-4526-9a1c-c5511006b19d', 'e3067d5f-9402-4502-a59a-c7b75f2be925'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:10 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Delete snapshot completed successfully. Nov 04 18:53:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c6bc1c5b-6ae6-4b2b-9f8d-8429e1b610fd tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-8521b241-e937-4a9e-9ca2-44203a3658e5-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] Creating offline snapshot 0fc70e5c-c56c-41e1-8403-34ae50cdfb1e of volume a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adb3e56-a12a-499c-bff7-f69cf26a825a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:11 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:53:11 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:11 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.500s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:11 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e 1G Nov 04 18:53:11 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Flow 'volume_create_manager' (ea1b9bd1-8930-4ab4-aa2c-9a1fc9d5bd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e4feaa-3bc6-4817-ac08-00f419b5575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e4feaa-3bc6-4817-ac08-00f419b5575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1347095384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4bc52c-eff3-4dde-8984-7acaf35c5099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b3a1bace5845e8b0784a66af32bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:12Z,use_quota=True,user_id='a53b4170eed343ffa85fcf54a6f85c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b877ffc7-94f6-471d-a0dd-50ad0ba8b579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b877ffc7-94f6-471d-a0dd-50ad0ba8b579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2812f7ef-35a6-4004-8a6d-c7f30ace47dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2812f7ef-35a6-4004-8a6d-c7f30ace47dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4bc52c-eff3-4dde-8984-7acaf35c5099', 'volume_name': 'volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0344889f-29d4-4cd8-8a78-b6420b6bdc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0344889f-29d4-4cd8-8a78-b6420b6bdc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44d139c-cdb1-4067-a9c3-ba37cdbd587f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:12 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Volume 1a4bc52c-eff3-4dde-8984-7acaf35c5099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099', 'volume_size': 1} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:12 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e 1G" returned: 0 in 0.600s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:12 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e Nov 04 18:53:12 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:12 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e" returned: 0 in 0.355s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:12 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e is being set with open permissions: ugo+rw Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:12 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e Nov 04 18:53:12 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:12 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e" returned: 0 in 0.263s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.971s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1347095384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4bc52c-eff3-4dde-8984-7acaf35c5099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b3a1bace5845e8b0784a66af32bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:12Z,use_quota=True,user_id='a53b4170eed343ffa85fcf54a6f85c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Creating volume 1a4bc52c-eff3-4dde-8984-7acaf35c5099 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:12 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:53:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:13 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099 1073741824 Nov 04 18:53:13 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:13 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-107b6fea-75c1-46ad-bedc-2e70c9073a58 tempest-SnapshotsActionsTest-1574537170 None] Create snapshot completed successfully Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-0fc70e5c-c56c-41e1-8403-34ae50cdfb1e-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-0fc70e5c-c56c-41e1-8403-34ae50cdfb1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Acquiring lock "cinder-quobyte-0fc70e5c-c56c-41e1-8403-34ae50cdfb1e" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-0fc70e5c-c56c-41e1-8403-34ae50cdfb1e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Deleting offline snapshot 0fc70e5c-c56c-41e1-8403-34ae50cdfb1e of volume a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] snapshot_file for this snap is: volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[466ed857-d06d-4012-9aa4-6ed3a3ff77f3]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:13 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099 1073741824" returned: 0 in 0.580s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:13 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e Nov 04 18:53:13 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:13 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099 Nov 04 18:53:13 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:13 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099" returned: 0 in 0.313s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44d139c-cdb1-4067-a9c3-ba37cdbd587f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ae07c6-519b-4c71-baf2-77296a7eeb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:13 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e" returned: 0 in 0.518s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:53:14 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Volume volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099 (1a4bc52c-eff3-4dde-8984-7acaf35c5099): created successfully Nov 04 18:53:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47ae07c6-519b-4c71-baf2-77296a7eeb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Flow 'volume_create_manager' (ea1b9bd1-8930-4ab4-aa2c-9a1fc9d5bd98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:14 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[85303165-97da-4eb2-8ef1-9d0d1738a1e7]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:14 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2fffb2ce-9c37-4b91-832d-35ca22890352 tempest-AttachVolumeTestJSON-1818572539 None] Created volume successfully. Nov 04 18:53:14 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:53:14 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:14 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.436s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:53:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:14 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e Nov 04 18:53:14 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:14 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e" returned: 0 in 0.493s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:14 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e Nov 04 18:53:14 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:15 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.0fc70e5c-c56c-41e1-8403-34ae50cdfb1e" returned: 0 in 0.301s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-0fc70e5c-c56c-41e1-8403-34ae50cdfb1e" released by "_delete_snapshot" :: held 1.886s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" released by "delete_snapshot" :: held 1.917s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:15 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Created reservations ['bc2f646a-1cd2-471b-ab5c-3b1362297361', '176198a0-820a-4947-969b-534621f3eedf', '93795569-f98b-4a50-854f-8799e764a26a', 'ede3004c-5f1a-4a23-9e32-9586535db7e6'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:15 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Delete snapshot completed successfully. Nov 04 18:53:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9542e039-4df2-4acd-890e-4b3c2a16fcbe tempest-SnapshotsActionsTest-549571245 None] Lock "cinder-0fc70e5c-c56c-41e1-8403-34ae50cdfb1e-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:16 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:53:16 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "cinder-7e38b6e4-9aee-4540-a5ab-72e5a9648a13-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Lock "cinder-7e38b6e4-9aee-4540-a5ab-72e5a9648a13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "cinder-quobyte-7e38b6e4-9aee-4540-a5ab-72e5a9648a13" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Lock "cinder-quobyte-7e38b6e4-9aee-4540-a5ab-72e5a9648a13" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Deleting offline snapshot 7e38b6e4-9aee-4540-a5ab-72e5a9648a13 of volume a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] snapshot_file for this snap is: volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:53:16 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[494953dd-eca9-467a-8c20-ae072b2819f4]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.402s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:16 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:53:16 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b08b8f38-73e1-4fb9-99d7-f59cafa2e2e1 req-1c15d039-1752-4dda-9f3a-260480feff50 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b08b8f38-73e1-4fb9-99d7-f59cafa2e2e1 req-1c15d039-1752-4dda-9f3a-260480feff50 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b08b8f38-73e1-4fb9-99d7-f59cafa2e2e1 req-1c15d039-1752-4dda-9f3a-260480feff50 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b08b8f38-73e1-4fb9-99d7-f59cafa2e2e1 req-1c15d039-1752-4dda-9f3a-260480feff50 tempest-AttachVolumeTestJSON-1818572539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9994cfe7-e0fc-43ea-9979-b0191fe6a536', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:53:16 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-b08b8f38-73e1-4fb9-99d7-f59cafa2e2e1 req-1c15d039-1752-4dda-9f3a-260480feff50 tempest-AttachVolumeTestJSON-1818572539 None] attachment_update completed successfully. Nov 04 18:53:16 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.441s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15077b6-12f0-4631-9aa0-df21c16d7aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:53:17 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c367222-443e-46b4-a06c-1bfdc21d5461]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:17 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef Nov 04 18:53:17 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:17 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef" returned: 0 in 0.559s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:17 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:53:17 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:18 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.503s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:18 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13 Nov 04 18:53:18 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:18 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef.7e38b6e4-9aee-4540-a5ab-72e5a9648a13" returned: 0 in 0.302s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Lock "cinder-quobyte-7e38b6e4-9aee-4540-a5ab-72e5a9648a13" released by "_delete_snapshot" :: held 1.969s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" released by "delete_snapshot" :: held 2.005s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:18 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Created reservations ['9b47871d-c7a0-4bd2-8adf-f203e9b597ba', 'f6fdab57-b020-4765-b38e-0262b2153885', '7b35ae99-c8e6-441a-a527-17340277f782', 'ec0bb04f-b66f-44fd-b1c4-6b0ce006fabd'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:18 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Delete snapshot completed successfully. Nov 04 18:53:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2e63b3a0-93a1-468a-845c-d5c9f904208a tempest-SnapshotsActionsTest-1574537170 None] Lock "cinder-7e38b6e4-9aee-4540-a5ab-72e5a9648a13-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "cinder-a15077b6-12f0-4631-9aa0-df21c16d7aef-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Lock "cinder-a15077b6-12f0-4631-9aa0-df21c16d7aef-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:19 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1218fa92-dee9-4ea4-9c25-22e0b101c422]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:19 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef Nov 04 18:53:19 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:20 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef" returned: 0 in 0.420s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:20 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef Nov 04 18:53:20 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:20 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a15077b6-12f0-4631-9aa0-df21c16d7aef" returned: 0 in 0.303s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Lock "cinder-quobyte-a15077b6-12f0-4631-9aa0-df21c16d7aef" released by "delete_volume" :: held 0.799s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:20 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Created reservations ['e2186674-615f-4868-8b2f-b65c400922c7', '3bf9a878-cfa2-4bb5-9907-980d9947d5f9', '75e97c57-9f94-4301-99b6-86d08a50b0f7', '89db7c89-4919-4995-ae21-1f64bdfa4440'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:20 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:53:20 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:21 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.399s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:21 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:21 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Deleted volume successfully. Nov 04 18:53:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-492197f0-1bab-49f4-99da-9d24eca816f7 tempest-SnapshotsActionsTest-1574537170 None] Lock "cinder-a15077b6-12f0-4631-9aa0-df21c16d7aef-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:30 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=60,cinder:UPDATE=71,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:53:31 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=77,cinder:UPDATE=76,cinder:INSERT=20,cinder:DELETE=9 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:53:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-6350d48d-d526-4ac3-9016-04981d419ba3 req-8588723c-863e-4023-ac9b-8e34f950102f tempest-TaggedAttachmentsTest-1998005791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-6350d48d-d526-4ac3-9016-04981d419ba3 req-8588723c-863e-4023-ac9b-8e34f950102f tempest-TaggedAttachmentsTest-1998005791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-6350d48d-d526-4ac3-9016-04981d419ba3 req-8588723c-863e-4023-ac9b-8e34f950102f tempest-TaggedAttachmentsTest-1998005791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-6350d48d-d526-4ac3-9016-04981d419ba3 req-8588723c-863e-4023-ac9b-8e34f950102f tempest-TaggedAttachmentsTest-1998005791 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31bf064b-1e79-420b-a6c2-70a0846b56bc', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:53:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-6350d48d-d526-4ac3-9016-04981d419ba3 req-8588723c-863e-4023-ac9b-8e34f950102f tempest-TaggedAttachmentsTest-1998005791 None] attachment_update completed successfully. Nov 04 18:53:38 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-b527fd83-d6ec-4eea-b849-6c52330ca53f req-d0b63047-a696-4b97-9c64-a05e34411c60 tempest-TaggedAttachmentsTest-1998005791 None] Terminate volume connection completed successfully. Nov 04 18:53:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b527fd83-d6ec-4eea-b849-6c52330ca53f req-d0b63047-a696-4b97-9c64-a05e34411c60 tempest-TaggedAttachmentsTest-1998005791 None] Deleting attachment 31bf064b-1e79-420b-a6c2-70a0846b56bc. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:53:47 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:53:48 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Flow 'volume_create_manager' (133a3bb1-d2e4-4223-a146-92896dda902c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af25a753-7c0c-4d32-a19f-06461ea05c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af25a753-7c0c-4d32-a19f-06461ea05c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1204143063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734a54d7-2227-4cf8-9798-4ccbae0abbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e049a26cd2d8466e9d760c698abd54bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:53Z,use_quota=True,user_id='b31e025b71a248c9b7a91511c4bfedd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0609df5b-43d6-4035-9fde-1317fc7ba3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0609df5b-43d6-4035-9fde-1317fc7ba3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585a8951-42ed-49b9-9de7-894d9725984d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585a8951-42ed-49b9-9de7-894d9725984d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734a54d7-2227-4cf8-9798-4ccbae0abbb5', 'volume_name': 'volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12a08bd-6c35-469f-89ae-6f5d835cfd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12a08bd-6c35-469f-89ae-6f5d835cfd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1fbe71-dd4a-48ec-ac46-833003a968a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:53 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Volume 734a54d7-2227-4cf8-9798-4ccbae0abbb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5', 'volume_size': 1} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1204143063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734a54d7-2227-4cf8-9798-4ccbae0abbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e049a26cd2d8466e9d760c698abd54bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:53:53Z,use_quota=True,user_id='b31e025b71a248c9b7a91511c4bfedd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Creating volume 734a54d7-2227-4cf8-9798-4ccbae0abbb5 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:53:53 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:53:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:53 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5 1073741824 Nov 04 18:53:53 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:54 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5 1073741824" returned: 0 in 0.814s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:54 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5 Nov 04 18:53:54 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:54 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5" returned: 0 in 0.323s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:53:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1fbe71-dd4a-48ec-ac46-833003a968a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c719291-6130-4c4b-9933-0ad462e6de68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:53:54 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Volume volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5 (734a54d7-2227-4cf8-9798-4ccbae0abbb5): created successfully Nov 04 18:53:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c719291-6130-4c4b-9933-0ad462e6de68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:53:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Flow 'volume_create_manager' (133a3bb1-d2e4-4223-a146-92896dda902c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:53:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-23df9fbd-b784-42f6-818b-c771da617919 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Created volume successfully. Nov 04 18:53:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Acquiring lock "cinder-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Lock "cinder-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Acquiring lock "cinder-quobyte-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Lock "cinder-quobyte-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:55 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd8e946-a80f-41d1-9db1-a9cbb12c8905]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:55 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48 Nov 04 18:53:55 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:55 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48" returned: 0 in 0.440s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:55 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48 Nov 04 18:53:55 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:56 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48" returned: 0 in 0.290s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Lock "cinder-quobyte-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48" released by "delete_volume" :: held 0.796s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Created reservations ['50dea272-cc97-478d-b7d7-217a878d97c3', '9dc1a53f-5e50-494d-b6d3-abff1d389b7d', '74ddf900-93ca-4106-aa19-d56b2f738208', '0b3215f2-35b1-4966-8bc2-c96f8b645fa8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:56 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:53:56 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:56 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.375s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:56 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Deleted volume successfully. Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7c108308-f45f-4617-8536-186a4a9b7a6b tempest-TaggedAttachmentsTest-1998005791 None] Lock "cinder-40a778bf-ad42-4c7d-a5b2-d66f20a4ee48-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Acquiring lock "cinder-734a54d7-2227-4cf8-9798-4ccbae0abbb5-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Lock "cinder-734a54d7-2227-4cf8-9798-4ccbae0abbb5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Acquiring lock "cinder-quobyte-734a54d7-2227-4cf8-9798-4ccbae0abbb5" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Lock "cinder-quobyte-734a54d7-2227-4cf8-9798-4ccbae0abbb5" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e90d90-e9b6-4ae8-8ca3-8aec8ce83544]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:53:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:57 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5 Nov 04 18:53:57 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:57 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5" returned: 0 in 0.432s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:57 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5 Nov 04 18:53:57 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:57 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-734a54d7-2227-4cf8-9798-4ccbae0abbb5" returned: 0 in 0.339s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Lock "cinder-quobyte-734a54d7-2227-4cf8-9798-4ccbae0abbb5" released by "delete_volume" :: held 0.823s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:53:57 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Created reservations ['c5594648-d6ea-497d-bcf5-550d089e580d', 'd52a9909-5ba0-414a-af4f-87237106696c', 'dad69419-7f75-4a77-aa26-41352e091081', '5e32d4b8-2070-470e-846c-79953f876f6b'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:53:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:53:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:53:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:53:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:53:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:53:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:53:57 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:53:57 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:53:58 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Nov 04 18:53:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.313s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:53:58 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:53:58 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Deleted volume successfully. Nov 04 18:53:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b1d23993-0b08-4665-9073-fa9facdf9829 tempest-VolumeQuotasNegativeTestJSON-1130693415 None] Lock "cinder-734a54d7-2227-4cf8-9798-4ccbae0abbb5-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:07 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=13,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:54:08 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=14,cinder:SELECT=11,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:54:09 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-480315c0-551f-47b1-8425-cb573f152c6e req-41aa0888-b469-4e62-818a-f86ecbcf4ce5 tempest-AttachVolumeTestJSON-1818572539 None] Terminate volume connection completed successfully. Nov 04 18:54:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-480315c0-551f-47b1-8425-cb573f152c6e req-41aa0888-b469-4e62-818a-f86ecbcf4ce5 tempest-AttachVolumeTestJSON-1818572539 None] Deleting attachment 9994cfe7-e0fc-43ea-9979-b0191fe6a536. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Flow 'volume_create_manager' (70241c91-e7dd-4a6b-9f47-5ef549b004af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4bf193-00d3-4bb9-9e49-1e007bcda31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4bf193-00d3-4bb9-9e49-1e007bcda31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1434799219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48127754-4707-432e-85f2-3ca44f484249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb19ea4c93247348ec4c7b581d8c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:10Z,use_quota=True,user_id='ad6fa184d99f406082fdb29e89f23636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a70238d-3c7f-4142-9be3-9714b830d150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a70238d-3c7f-4142-9be3-9714b830d150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5c7392-696c-476c-b500-fd5a6c5b09a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5c7392-696c-476c-b500-fd5a6c5b09a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48127754-4707-432e-85f2-3ca44f484249', 'volume_name': 'volume-48127754-4707-432e-85f2-3ca44f484249', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db70025a-7f49-447e-a23e-806e35b71ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db70025a-7f49-447e-a23e-806e35b71ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39788a98-c945-4d24-8e26-ff102b114d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:10 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Volume 48127754-4707-432e-85f2-3ca44f484249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48127754-4707-432e-85f2-3ca44f484249', 'volume_size': 1} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1434799219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48127754-4707-432e-85f2-3ca44f484249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb19ea4c93247348ec4c7b581d8c64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:10Z,use_quota=True,user_id='ad6fa184d99f406082fdb29e89f23636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Creating volume 48127754-4707-432e-85f2-3ca44f484249 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:54:10 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:10 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249 1073741824 Nov 04 18:54:10 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:10 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249 1073741824" returned: 0 in 0.717s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:10 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249 Nov 04 18:54:10 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:11 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249" returned: 0 in 0.278s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:54:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39788a98-c945-4d24-8e26-ff102b114d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48127754-4707-432e-85f2-3ca44f484249', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bb6730-843e-49a5-8b1d-721f3403737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:11 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Volume volume-48127754-4707-432e-85f2-3ca44f484249 (48127754-4707-432e-85f2-3ca44f484249): created successfully Nov 04 18:54:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21bb6730-843e-49a5-8b1d-721f3403737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Flow 'volume_create_manager' (70241c91-e7dd-4a6b-9f47-5ef549b004af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:11 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-74259679-491e-4ac9-9a36-3e403c2677e7 tempest-AttachVolumeShelveTestJSON-770796833 None] Created volume successfully. Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Flow 'volume_create_manager' (ddbd2f98-6749-4bc5-9576-a2bb7a3ee05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243fd221-4811-4342-aa09-ad233549603f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243fd221-4811-4342-aa09-ad233549603f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-174742912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b5f728-f8b6-4262-b7bc-9c2f125ac2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f7107996894e659bdd589190813b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:13Z,use_quota=True,user_id='5f771001899f4f9397fb54b065b91f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(664e77f5-d726-43b7-b060-333a874e8dcf),volume_type_id=664e77f5-d726-43b7-b060-333a874e8dcf)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76a791f-ecd2-432a-a508-d2a73b1369b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76a791f-ecd2-432a-a508-d2a73b1369b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775aa6e6-bf7b-4da9-8bc6-63385d8e8919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775aa6e6-bf7b-4da9-8bc6-63385d8e8919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b5f728-f8b6-4262-b7bc-9c2f125ac2d3', 'volume_name': 'volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e3ec92-7d13-41ad-9ee9-2c74b90d8dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e3ec92-7d13-41ad-9ee9-2c74b90d8dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7195a8d-789b-4a10-b332-a2c36e00d421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:13 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Volume 15b5f728-f8b6-4262-b7bc-9c2f125ac2d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3', 'volume_size': 1} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-174742912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b5f728-f8b6-4262-b7bc-9c2f125ac2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f7107996894e659bdd589190813b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:13Z,use_quota=True,user_id='5f771001899f4f9397fb54b065b91f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(664e77f5-d726-43b7-b060-333a874e8dcf),volume_type_id=664e77f5-d726-43b7-b060-333a874e8dcf)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Creating volume 15b5f728-f8b6-4262-b7bc-9c2f125ac2d3 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:54:13 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:54:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:13 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3 1073741824 Nov 04 18:54:13 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:14 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3 1073741824" returned: 0 in 0.895s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:14 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3 Nov 04 18:54:14 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:14 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3" returned: 0 in 0.474s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:54:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7195a8d-789b-4a10-b332-a2c36e00d421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1a31ed-c585-422c-8ed5-d6b7e34a968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:14 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Volume volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3 (15b5f728-f8b6-4262-b7bc-9c2f125ac2d3): created successfully Nov 04 18:54:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1a31ed-c585-422c-8ed5-d6b7e34a968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Flow 'volume_create_manager' (ddbd2f98-6749-4bc5-9576-a2bb7a3ee05d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:14 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1a78c661-8417-4eff-a7f7-7c90fcda4c80 tempest-VolumeTypesAccessTest-91498228 None] Created volume successfully. Nov 04 18:54:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Acquiring lock "cinder-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Lock "cinder-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Acquiring lock "cinder-quobyte-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Lock "cinder-quobyte-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3" acquired by "delete_volume" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:15 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b773026-dbad-4350-861b-446733b0e892]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:16 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3 Nov 04 18:54:16 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:16 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:54:16 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:16 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3" returned: 0 in 0.642s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:16 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3 Nov 04 18:54:16 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.558s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:16 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 8 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:54:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:54:17 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3" returned: 0 in 0.766s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Lock "cinder-quobyte-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3" released by "delete_volume" :: held 1.521s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:17 devstack cinder-volume[87364]: WARNING cinder.quota [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1935261967 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1935261967, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:54:17 devstack cinder-volume[87364]: WARNING cinder.quota [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1935261967 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1935261967, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:54:17 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Created reservations ['243df04c-9645-4175-80d6-882f700746b3', 'f9a64ff7-1e93-490b-9932-952828ff801d', 'f9475c59-cc64-45de-83de-947fec5746ae', '4c4b46ac-6f0c-4e72-85cc-19eeed920238'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:17 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:54:17 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:18 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.509s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:18 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:18 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Deleted volume successfully. Nov 04 18:54:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-761b730e-42ce-48b5-a14c-5682eb98743a tempest-VolumeTypesAccessTest-91498228 None] Lock "cinder-15b5f728-f8b6-4262-b7bc-9c2f125ac2d3-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:27 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=10,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:54:28 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Flow 'volume_create_manager' (ac57b5be-bcdc-49fc-8da4-687af6dd63e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1657c459-90f0-46ca-8aec-a5e308c83aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1657c459-90f0-46ca-8aec-a5e308c83aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-576765323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2ed649-e46c-42b4-b247-efe0df16fa2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f540f7ba2db42b285b5c2fd06843279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:32Z,use_quota=True,user_id='cc7db7eb1ccb4a688e80af1e6e9abe46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96d1356-6d78-4316-8746-09bf9a2da3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96d1356-6d78-4316-8746-09bf9a2da3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81e5846-4b98-4b5e-a3b0-c3fcc266abae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.image.glance [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Creating Keystone auth plugin from conf {{(pid=87364) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-ff24bcd3-d6ff-4c00-a995-39a9c6cd01df req-327d1d51-dbd8-4750-a0ec-ad43d7f205ff tempest-AttachVolumeShelveTestJSON-770796833 None] No connector for attachment c46d5f1a-831f-4c24-a884-c106e90f2cf7; skipping storage backend terminate_connection call. {{(pid=87364) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-ff24bcd3-d6ff-4c00-a995-39a9c6cd01df req-327d1d51-dbd8-4750-a0ec-ad43d7f205ff tempest-AttachVolumeShelveTestJSON-770796833 None] Deleting attachment c46d5f1a-831f-4c24-a884-c106e90f2cf7. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81e5846-4b98-4b5e-a3b0-c3fcc266abae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c2ed649-e46c-42b4-b247-efe0df16fa2f', 'volume_name': 'volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28078ac2-808f-45ae-b2d7-6d59076b295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28078ac2-808f-45ae-b2d7-6d59076b295d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3b4148-fad8-483c-9bd3-4ad4632ceb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:32 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Volume 7c2ed649-e46c-42b4-b247-efe0df16fa2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 18:54:32 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Trying to clone 7c2ed649-e46c-42b4-b247-efe0df16fa2f from image 49906b66-c86b-4e49-9cb0-47d303080f8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]). {{(pid=87364) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 18:54:33 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 18:54:33 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Image download 20.69 MB at 20.69 MB/s Nov 04 18:54:33 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb1d4da-08ca-46d0-9ca6-cac5727841b0]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:33 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD Nov 04 18:54:33 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:33 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:33 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Temporary image 49906b66-c86b-4e49-9cb0-47d303080f8f is fetched for user cc7db7eb1ccb4a688e80af1e6e9abe46. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 18:54:33 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b9b336-da1c-4a9e-a537-90fa46ad3242]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:33 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD Nov 04 18:54:33 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:34 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-576765323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2ed649-e46c-42b4-b247-efe0df16fa2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f540f7ba2db42b285b5c2fd06843279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:32Z,use_quota=True,user_id='cc7db7eb1ccb4a688e80af1e6e9abe46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Creating volume 7c2ed649-e46c-42b4-b247-efe0df16fa2f {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:54:34 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:34 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f 1073741824 Nov 04 18:54:34 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:34 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f 1073741824" returned: 0 in 0.671s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:34 devstack sudo[91966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f Nov 04 18:54:34 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:35 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f" returned: 0 in 0.367s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:54:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:35 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Attempting download of 49906b66-c86b-4e49-9cb0-47d303080f8f ((None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}])) to volume 7c2ed649-e46c-42b4-b247-efe0df16fa2f. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 18:54:35 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4e5c8e-072a-42fd-8b15-cdc646ed245b]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_3pd77ozt {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:35 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_3pd77ozt Nov 04 18:54:35 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:35 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_3pd77ozt" returned: 0 in 0.456s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_3pd77ozt {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:35 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_3pd77ozt Nov 04 18:54:35 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:36 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_3pd77ozt" returned: 1 in 0.431s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_3pd77ozt' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 18:54:36 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ef9bc-be04-4c2e-967b-287494b13c75]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:36 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD Nov 04 18:54:36 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:36 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:36 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] 49906b66-c86b-4e49-9cb0-47d303080f8f was qcow2, converting to qcow2 {{(pid=87364) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 18:54:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:36 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f Nov 04 18:54:36 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:39 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f" returned: 0 in 3.395s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:39 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_sd4mj_gpdevstack@QuobyteHD, size 112.00 MB, duration 3.40 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:54:39 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Converted 112.00 MB image at 32.97 MB/s Nov 04 18:54:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:40 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f 1G Nov 04 18:54:40 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:40 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f 1G" returned: 0 in 0.697s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:40 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Downloaded image 49906b66-c86b-4e49-9cb0-47d303080f8f ((None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}])) to volume 7c2ed649-e46c-42b4-b247-efe0df16fa2f successfully. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 18:54:40 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Temporary image 49906b66-c86b-4e49-9cb0-47d303080f8f for user cc7db7eb1ccb4a688e80af1e6e9abe46 is deleted. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 18:54:40 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Marking volume 7c2ed649-e46c-42b4-b247-efe0df16fa2f as bootable. {{(pid=87364) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 18:54:40 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Copying metadata from image 49906b66-c86b-4e49-9cb0-47d303080f8f to 7c2ed649-e46c-42b4-b247-efe0df16fa2f. {{(pid=87364) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 18:54:40 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Creating volume glance metadata for volume 7c2ed649-e46c-42b4-b247-efe0df16fa2f backed by image 49906b66-c86b-4e49-9cb0-47d303080f8f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87364) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 18:54:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3b4148-fad8-483c-9bd3-4ad4632ceb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6eb16ac-0e67-4574-9e37-04d91ae1a3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:41 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Volume volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f (7c2ed649-e46c-42b4-b247-efe0df16fa2f): created successfully Nov 04 18:54:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6eb16ac-0e67-4574-9e37-04d91ae1a3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Flow 'volume_create_manager' (ac57b5be-bcdc-49fc-8da4-687af6dd63e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ca6b8423-10d5-4629-b87b-611a99bf8159 tempest-VolumesImageMetadata-1038339007 None] Created volume successfully. Nov 04 18:54:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Acquiring lock "cinder-7c2ed649-e46c-42b4-b247-efe0df16fa2f-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Lock "cinder-7c2ed649-e46c-42b4-b247-efe0df16fa2f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Acquiring lock "cinder-quobyte-7c2ed649-e46c-42b4-b247-efe0df16fa2f" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Lock "cinder-quobyte-7c2ed649-e46c-42b4-b247-efe0df16fa2f" acquired by "delete_volume" :: waited 0.058s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:43 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90869de-702b-4a23-8593-ba54c9d50fad]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:43 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f Nov 04 18:54:43 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:44 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f" returned: 0 in 0.596s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:44 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f Nov 04 18:54:44 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:44 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7c2ed649-e46c-42b4-b247-efe0df16fa2f" returned: 0 in 0.293s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Lock "cinder-quobyte-7c2ed649-e46c-42b4-b247-efe0df16fa2f" released by "delete_volume" :: held 1.018s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:44 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Created reservations ['0764f77c-d835-42cb-875a-85fc5e05022a', '39c77d73-6076-4b74-9aa4-4bdb69f7e661', '58dc194c-4be2-4227-bafe-4bd71970e417', 'a78e0890-b735-45c3-b7f3-678a699a95d0'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:45 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:45 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:54:45 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:45 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.462s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:45 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Deleted volume successfully. Nov 04 18:54:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-221515b4-e80a-4f1c-966d-d140e0b61684 tempest-VolumesImageMetadata-1038339007 None] Lock "cinder-7c2ed649-e46c-42b4-b247-efe0df16fa2f-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Flow 'volume_create_manager' (03ee8629-a1f7-47ea-96f8-799948c0834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c438ad-e34f-4a09-a29e-1ec469f2066d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c438ad-e34f-4a09-a29e-1ec469f2066d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2141453942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95934fc5-6022-4271-99b5-5ba40251182a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2836fa2c154e488a46640a9bd2f959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:54Z,use_quota=True,user_id='1824efe256a84b86875ca5c00a3441a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef85de7a-f647-4574-a70f-545b3a4f3101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef85de7a-f647-4574-a70f-545b3a4f3101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2a40cc-7458-4618-9eb1-5856e2b0c903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2a40cc-7458-4618-9eb1-5856e2b0c903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95934fc5-6022-4271-99b5-5ba40251182a', 'volume_name': 'volume-95934fc5-6022-4271-99b5-5ba40251182a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d121b4-b912-40ae-a1fc-2e4d29d73a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d121b4-b912-40ae-a1fc-2e4d29d73a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a0d6ba-bdcc-42b6-a781-bdd84c91d52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:53 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Volume 95934fc5-6022-4271-99b5-5ba40251182a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95934fc5-6022-4271-99b5-5ba40251182a', 'volume_size': 1} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2141453942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95934fc5-6022-4271-99b5-5ba40251182a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2836fa2c154e488a46640a9bd2f959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:54:54Z,use_quota=True,user_id='1824efe256a84b86875ca5c00a3441a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Creating volume 95934fc5-6022-4271-99b5-5ba40251182a {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:54:53 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:54:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:53 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a 1073741824 Nov 04 18:54:53 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:54 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a 1073741824" returned: 0 in 0.601s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:54 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a Nov 04 18:54:54 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:54 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a" returned: 0 in 0.412s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:54:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a0d6ba-bdcc-42b6-a781-bdd84c91d52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95934fc5-6022-4271-99b5-5ba40251182a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb80efc-86df-4ea1-ae04-92d0102e7a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:54:55 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Volume volume-95934fc5-6022-4271-99b5-5ba40251182a (95934fc5-6022-4271-99b5-5ba40251182a): created successfully Nov 04 18:54:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb80efc-86df-4ea1-ae04-92d0102e7a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:54:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Flow 'volume_create_manager' (03ee8629-a1f7-47ea-96f8-799948c0834e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:54:55 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-da4589df-288d-4952-9348-dc989e8b0541 tempest-VolumesMetadataTest-1289154976 None] Created volume successfully. Nov 04 18:54:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Acquiring lock "cinder-95934fc5-6022-4271-99b5-5ba40251182a-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Lock "cinder-95934fc5-6022-4271-99b5-5ba40251182a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Acquiring lock "cinder-quobyte-95934fc5-6022-4271-99b5-5ba40251182a" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:54:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Lock "cinder-quobyte-95934fc5-6022-4271-99b5-5ba40251182a" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:54:57 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ee2208-883b-4ca0-b9f7-bb795af84a80]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:54:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:57 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a Nov 04 18:54:57 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:57 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a" returned: 0 in 0.554s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:57 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a Nov 04 18:54:57 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:58 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95934fc5-6022-4271-99b5-5ba40251182a" returned: 0 in 0.386s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Lock "cinder-quobyte-95934fc5-6022-4271-99b5-5ba40251182a" released by "delete_volume" :: held 1.011s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Created reservations ['d5720e6f-6cf4-427a-8b01-f5d1bbc2d6fc', '54ba7b0c-cae8-4b2e-b86d-091738a3b2d9', 'e877c5fe-0342-4103-a795-3e8de6010696', '6f21c861-9239-40fb-acb7-7663099c783c'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:54:58 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:54:58 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:54:58 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.296s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:54:58 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Deleted volume successfully. Nov 04 18:54:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-eb0859b9-fc08-4d08-84de-fbf40c8ed909 tempest-VolumesMetadataTest-1289154976 None] Lock "cinder-95934fc5-6022-4271-99b5-5ba40251182a-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:07 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Flow 'volume_create_manager' (0b79ea59-bd9c-4f92-b228-ec9f8ccea367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e8f598-f319-404b-8ad0-1367c0e43816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e8f598-f319-404b-8ad0-1367c0e43816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-33334245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca4f364-44c7-420a-a6db-d09ed6170e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9279b14e65854c9a8afa3bc3838474eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:08Z,use_quota=True,user_id='75dbd134fe4d4069b5a90a827eea045d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff35928b-1217-4235-aa51-91c043851664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff35928b-1217-4235-aa51-91c043851664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b2cd53-2fed-45d1-bce6-3b1d1d4d5f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b2cd53-2fed-45d1-bce6-3b1d1d4d5f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca4f364-44c7-420a-a6db-d09ed6170e32', 'volume_name': 'volume-bca4f364-44c7-420a-a6db-d09ed6170e32', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a677e67b-31b4-4c0c-8b92-9e152bcdfbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a677e67b-31b4-4c0c-8b92-9e152bcdfbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d776f3d5-98d5-46d0-bffa-6acc3f659210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:08 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Volume bca4f364-44c7-420a-a6db-d09ed6170e32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca4f364-44c7-420a-a6db-d09ed6170e32', 'volume_size': 1} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-33334245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca4f364-44c7-420a-a6db-d09ed6170e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9279b14e65854c9a8afa3bc3838474eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:08Z,use_quota=True,user_id='75dbd134fe4d4069b5a90a827eea045d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Creating volume bca4f364-44c7-420a-a6db-d09ed6170e32 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:08 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:55:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:08 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32 1073741824 Nov 04 18:55:08 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:09 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32 1073741824" returned: 0 in 1.121s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:09 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32 Nov 04 18:55:09 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:09 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32" returned: 0 in 0.497s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:09 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d776f3d5-98d5-46d0-bffa-6acc3f659210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca4f364-44c7-420a-a6db-d09ed6170e32', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848374fe-601d-4746-bdb4-83bd68021bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:09 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Volume volume-bca4f364-44c7-420a-a6db-d09ed6170e32 (bca4f364-44c7-420a-a6db-d09ed6170e32): created successfully Nov 04 18:55:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848374fe-601d-4746-bdb4-83bd68021bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Flow 'volume_create_manager' (0b79ea59-bd9c-4f92-b228-ec9f8ccea367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:09 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-34382af6-447d-4a9d-913e-0c282e90325f tempest-ServerActionsTestOtherA-510348025 None] Created volume successfully. Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Flow 'volume_create_manager' (1fde0f83-c01e-4c3d-8d81-d0e894772324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e6e962-0593-48ce-a6c8-02d818bb7eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e6e962-0593-48ce-a6c8-02d818bb7eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-833804116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8761b29e-8531-48a5-9180-8ac1684bd07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8999ba83cb714929b44a62230fb175c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:11Z,use_quota=True,user_id='821f2a3ed0484b8683f08893c918f248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1978a40c-95ec-42d8-bbfa-ebc351deddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1978a40c-95ec-42d8-bbfa-ebc351deddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51368f91-92a5-45e1-9b00-30bd93e6c34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51368f91-92a5-45e1-9b00-30bd93e6c34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8761b29e-8531-48a5-9180-8ac1684bd07c', 'volume_name': 'volume-8761b29e-8531-48a5-9180-8ac1684bd07c', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897ed1e1-9894-442e-8b60-7b9286f8f0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897ed1e1-9894-442e-8b60-7b9286f8f0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ba1cd5-fc9a-477f-b24e-9bc67c5af65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:10 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Volume 8761b29e-8531-48a5-9180-8ac1684bd07c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8761b29e-8531-48a5-9180-8ac1684bd07c', 'volume_size': 1} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-833804116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8761b29e-8531-48a5-9180-8ac1684bd07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8999ba83cb714929b44a62230fb175c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:11Z,use_quota=True,user_id='821f2a3ed0484b8683f08893c918f248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Creating volume 8761b29e-8531-48a5-9180-8ac1684bd07c {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:10 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:55:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:10 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c 1073741824 Nov 04 18:55:10 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:11 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c 1073741824" returned: 0 in 0.528s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:11 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c Nov 04 18:55:11 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:11 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c" returned: 0 in 0.300s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ba1cd5-fc9a-477f-b24e-9bc67c5af65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8761b29e-8531-48a5-9180-8ac1684bd07c', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ed48a6-30b8-46d9-9eef-c4c20d0d048c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:11 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Volume volume-8761b29e-8531-48a5-9180-8ac1684bd07c (8761b29e-8531-48a5-9180-8ac1684bd07c): created successfully Nov 04 18:55:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ed48a6-30b8-46d9-9eef-c4c20d0d048c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Flow 'volume_create_manager' (1fde0f83-c01e-4c3d-8d81-d0e894772324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:11 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3cfe2fb6-4b9d-4e07-8e9b-18c16f95e18d tempest-VolumesTransfersV357Test-1521012557 None] Created volume successfully. Nov 04 18:55:13 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4d922d44-5d40-407d-bd95-3ac2f50bec05 tempest-VolumesTransfersV357Test-1810272680 None] Transfer volume completed successfully. Nov 04 18:55:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Acquiring lock "cinder-8761b29e-8531-48a5-9180-8ac1684bd07c-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Lock "cinder-8761b29e-8531-48a5-9180-8ac1684bd07c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Acquiring lock "cinder-quobyte-8761b29e-8531-48a5-9180-8ac1684bd07c" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Lock "cinder-quobyte-8761b29e-8531-48a5-9180-8ac1684bd07c" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:14 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2baa72-4163-411b-96c2-5992ff5080f3]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:14 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c Nov 04 18:55:14 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:15 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c" returned: 0 in 0.607s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:15 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c Nov 04 18:55:15 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:15 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8761b29e-8531-48a5-9180-8ac1684bd07c" returned: 0 in 0.338s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Lock "cinder-quobyte-8761b29e-8531-48a5-9180-8ac1684bd07c" released by "delete_volume" :: held 1.031s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:15 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Created reservations ['38c1e15e-aacf-4df6-ad32-3558d3e6b2fb', 'ba7bf8fc-defd-4426-b7f5-3f05b6c0d2db', '8f58a676-396d-4032-8aa0-057b5121e922', '7db2beec-b0b1-4198-9472-f832c897ccb8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:15 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:55:15 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:16 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:55:16 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:16 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.456s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:16 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Deleted volume successfully. Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a9d966c-8d28-4221-bae7-e5ca86323145 tempest-VolumesTransfersV357Test-233385072 None] Lock "cinder-8761b29e-8531-48a5-9180-8ac1684bd07c-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:16 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.520s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:55:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Flow 'volume_create_manager' (96ec921b-5d37-4bf4-90eb-3234ced5875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06792f74-25da-4a47-b826-2bb9629b2b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06792f74-25da-4a47-b826-2bb9629b2b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-748397140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7f5b04-dfa3-43ed-930c-c6c39ceafb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8999ba83cb714929b44a62230fb175c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:18Z,use_quota=True,user_id='821f2a3ed0484b8683f08893c918f248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77d3158-b212-48cc-8500-f2c5efb34b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77d3158-b212-48cc-8500-f2c5efb34b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dcf590-ff40-4197-a219-9c0d14f4eeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dcf590-ff40-4197-a219-9c0d14f4eeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc7f5b04-dfa3-43ed-930c-c6c39ceafb43', 'volume_name': 'volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dc8314-0251-44b7-b0ab-d568ed0d9b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dc8314-0251-44b7-b0ab-d568ed0d9b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757e7881-1340-4e1e-85f6-fdce14620559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:17 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Volume bc7f5b04-dfa3-43ed-930c-c6c39ceafb43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43', 'volume_size': 1} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-748397140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7f5b04-dfa3-43ed-930c-c6c39ceafb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8999ba83cb714929b44a62230fb175c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:18Z,use_quota=True,user_id='821f2a3ed0484b8683f08893c918f248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Creating volume bc7f5b04-dfa3-43ed-930c-c6c39ceafb43 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:17 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:55:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:17 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43 1073741824 Nov 04 18:55:17 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:18 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43 1073741824" returned: 0 in 0.573s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:18 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43 Nov 04 18:55:18 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:19 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43" returned: 0 in 0.459s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757e7881-1340-4e1e-85f6-fdce14620559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef95e39-c952-4d95-8340-c54a0439e875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:19 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Volume volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43 (bc7f5b04-dfa3-43ed-930c-c6c39ceafb43): created successfully Nov 04 18:55:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef95e39-c952-4d95-8340-c54a0439e875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Flow 'volume_create_manager' (96ec921b-5d37-4bf4-90eb-3234ced5875b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:19 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7766680e-b04b-49ab-82f8-10cea409c4ac tempest-VolumesTransfersV357Test-1521012557 None] Created volume successfully. Nov 04 18:55:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Acquiring lock "cinder-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Lock "cinder-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Acquiring lock "cinder-quobyte-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Lock "cinder-quobyte-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43" acquired by "delete_volume" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:20 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef08f43-70d1-4140-9439-eb363a09be4f]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:20 devstack sudo[92981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43 Nov 04 18:55:20 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:20 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43" returned: 0 in 0.501s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:20 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43 Nov 04 18:55:20 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:21 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43" returned: 0 in 0.289s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Lock "cinder-quobyte-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43" released by "delete_volume" :: held 0.854s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Created reservations ['69983f2a-6736-45ac-9c98-37f706fa0ffc', 'ef3c94bb-7e86-472b-9de4-e9093934348f', 'c287b6c9-2c88-4d1c-aed1-40167c2f6437', '9c018d77-afd3-48bf-9f5c-660672a37e03'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:21 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:55:21 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:21 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.276s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:21 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Deleted volume successfully. Nov 04 18:55:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-edd64fae-7a62-4acb-a350-50efb1a4af0f tempest-VolumesTransfersV357Test-233385072 None] Lock "cinder-bc7f5b04-dfa3-43ed-930c-c6c39ceafb43-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Flow 'volume_create_manager' (070f046c-7f08-42ec-99c6-b123d2b0392d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c2485f-4fe5-4f9a-99c0-721e596eecd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c2485f-4fe5-4f9a-99c0-721e596eecd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1014751531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b3a1bace5845e8b0784a66af32bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:27Z,use_quota=True,user_id='a53b4170eed343ffa85fcf54a6f85c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8365344-c351-40f2-b05a-9fb90c0062f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8365344-c351-40f2-b05a-9fb90c0062f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c4fb73-2660-42aa-9a8f-ba81c37661a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c4fb73-2660-42aa-9a8f-ba81c37661a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff', 'volume_name': 'volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e77a875-300d-4fa7-805c-fafb0b0f204b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e77a875-300d-4fa7-805c-fafb0b0f204b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06aef789-a5e4-4973-82e8-ff8de4bd0681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:27 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Volume 68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff', 'volume_size': 1} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1014751531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b3a1bace5845e8b0784a66af32bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:27Z,use_quota=True,user_id='a53b4170eed343ffa85fcf54a6f85c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Creating volume 68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:27 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:27 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff 1073741824 Nov 04 18:55:27 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:27 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff 1073741824" returned: 0 in 0.496s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=39,cinder:UPDATE=51,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:55:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:27 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff Nov 04 18:55:27 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:28 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff" returned: 0 in 0.288s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06aef789-a5e4-4973-82e8-ff8de4bd0681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d20bbbc-10a1-4a6b-8d91-b61b4359a6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:28 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Volume volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff (68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff): created successfully Nov 04 18:55:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d20bbbc-10a1-4a6b-8d91-b61b4359a6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Flow 'volume_create_manager' (070f046c-7f08-42ec-99c6-b123d2b0392d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:28 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e91257ea-b587-4d75-b94d-492231e434c8 tempest-AttachVolumeTestJSON-1818572539 None] Created volume successfully. Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=52,cinder:SELECT=43,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Flow 'volume_create_manager' (9521cb98-b1f4-4fce-99b5-c8d6f6a7d212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d994d84-0a21-46bd-aaad-50d9dac74350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d994d84-0a21-46bd-aaad-50d9dac74350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1746716027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d865de7c-ed85-41e2-826d-c231c62feb8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1020139280499db13211bc756ff5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:29Z,use_quota=True,user_id='0652fcf9d27d4af6963e63af8c04633f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c785ba9-573b-4a9d-af97-b6c35bd14dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c785ba9-573b-4a9d-af97-b6c35bd14dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafd0960-82a1-428c-acc8-9ab9a1d40148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.image.glance [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Creating Keystone auth plugin from conf {{(pid=87364) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafd0960-82a1-428c-acc8-9ab9a1d40148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd865de7c-ed85-41e2-826d-c231c62feb8c', 'volume_name': 'volume-d865de7c-ed85-41e2-826d-c231c62feb8c', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6c27ff-294c-43e3-ab4d-d8588c5c1a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6c27ff-294c-43e3-ab4d-d8588c5c1a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71720307-ef27-4a31-8c37-2ffb25553686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:29 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Volume d865de7c-ed85-41e2-826d-c231c62feb8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d865de7c-ed85-41e2-826d-c231c62feb8c', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 18:55:29 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Trying to clone d865de7c-ed85-41e2-826d-c231c62feb8c from image 49906b66-c86b-4e49-9cb0-47d303080f8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]). {{(pid=87364) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 18:55:30 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 18:55:30 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Image download 20.69 MB at 20.69 MB/s Nov 04 18:55:30 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d76094-25c5-4fac-bdbc-ef706cdc7187]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:30 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD Nov 04 18:55:30 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-5a401ba1-684c-45a2-827b-476d41a1b9d6 req-858fd995-fb54-429f-b293-02198013f234 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-5a401ba1-684c-45a2-827b-476d41a1b9d6 req-858fd995-fb54-429f-b293-02198013f234 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-5a401ba1-684c-45a2-827b-476d41a1b9d6 req-858fd995-fb54-429f-b293-02198013f234 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-5a401ba1-684c-45a2-827b-476d41a1b9d6 req-858fd995-fb54-429f-b293-02198013f234 tempest-AttachVolumeTestJSON-1818572539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77957a63-9a6f-4d63-9058-7d9623bfd996', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:55:30 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:30 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Temporary image 49906b66-c86b-4e49-9cb0-47d303080f8f is fetched for user 0652fcf9d27d4af6963e63af8c04633f. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 18:55:30 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-5a401ba1-684c-45a2-827b-476d41a1b9d6 req-858fd995-fb54-429f-b293-02198013f234 tempest-AttachVolumeTestJSON-1818572539 None] attachment_update completed successfully. Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ae38fa-aa9c-4be8-902f-dfba708d066c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:31 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD Nov 04 18:55:31 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:31 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1746716027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d865de7c-ed85-41e2-826d-c231c62feb8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1020139280499db13211bc756ff5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:29Z,use_quota=True,user_id='0652fcf9d27d4af6963e63af8c04633f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Creating volume d865de7c-ed85-41e2-826d-c231c62feb8c {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:31 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:55:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:31 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c 1073741824 Nov 04 18:55:31 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:32 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c 1073741824" returned: 0 in 0.817s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:32 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c Nov 04 18:55:32 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:33 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c" returned: 0 in 0.412s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:33 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Attempting download of 49906b66-c86b-4e49-9cb0-47d303080f8f ((None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}])) to volume d865de7c-ed85-41e2-826d-c231c62feb8c. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 18:55:33 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2c0458-f03d-4224-9928-b29a6f47a7c0]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_2kiy1llu {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:33 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_2kiy1llu Nov 04 18:55:33 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:33 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_2kiy1llu" returned: 0 in 0.527s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_2kiy1llu {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:34 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_2kiy1llu Nov 04 18:55:34 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:34 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_2kiy1llu" returned: 1 in 0.479s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_2kiy1llu' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 18:55:34 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72f70fa-1a6b-4ede-81b0-9efe8c7151b8]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:34 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD Nov 04 18:55:34 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:35 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Flow 'volume_create_manager' (21a8ba92-4b8d-4d39-9dec-34af0c45169f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d5b31f-c91b-40a2-bb49-d2ff5b393e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] 49906b66-c86b-4e49-9cb0-47d303080f8f was qcow2, converting to qcow2 {{(pid=87364) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:35 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c Nov 04 18:55:35 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d5b31f-c91b-40a2-bb49-d2ff5b393e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2077393945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd889751-27f4-4c0e-970f-6740fc3447c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b3a1bace5845e8b0784a66af32bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:35Z,use_quota=True,user_id='a53b4170eed343ffa85fcf54a6f85c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bae82f-8284-4c29-985c-12f20c9d65f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bae82f-8284-4c29-985c-12f20c9d65f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ad283a-1288-403f-93fc-4ac981068f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ad283a-1288-403f-93fc-4ac981068f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd889751-27f4-4c0e-970f-6740fc3447c3', 'volume_name': 'volume-bd889751-27f4-4c0e-970f-6740fc3447c3', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9570c268-4baa-4af6-aa44-0d58993a0ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9570c268-4baa-4af6-aa44-0d58993a0ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0637f9e-6f07-4cfa-a8fb-23c9c09b4743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:35 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Volume bd889751-27f4-4c0e-970f-6740fc3447c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd889751-27f4-4c0e-970f-6740fc3447c3', 'volume_size': 1} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2077393945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd889751-27f4-4c0e-970f-6740fc3447c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b3a1bace5845e8b0784a66af32bfb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:35Z,use_quota=True,user_id='a53b4170eed343ffa85fcf54a6f85c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Creating volume bd889751-27f4-4c0e-970f-6740fc3447c3 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:35 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:35 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3 1073741824 Nov 04 18:55:35 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:35 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3 1073741824" returned: 0 in 0.525s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:35 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3 Nov 04 18:55:35 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:36 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3" returned: 0 in 0.508s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0637f9e-6f07-4cfa-a8fb-23c9c09b4743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd889751-27f4-4c0e-970f-6740fc3447c3', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad673eb7-0437-4122-a45d-a00496afccea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:36 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Volume volume-bd889751-27f4-4c0e-970f-6740fc3447c3 (bd889751-27f4-4c0e-970f-6740fc3447c3): created successfully Nov 04 18:55:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad673eb7-0437-4122-a45d-a00496afccea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Flow 'volume_create_manager' (21a8ba92-4b8d-4d39-9dec-34af0c45169f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-87dd6e87-16af-46bc-b36b-ad8bb0a32ff8 tempest-AttachVolumeTestJSON-1818572539 None] Created volume successfully. Nov 04 18:55:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Acquiring lock "cinder-48127754-4707-432e-85f2-3ca44f484249-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Lock "cinder-48127754-4707-432e-85f2-3ca44f484249-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Acquiring lock "cinder-quobyte-48127754-4707-432e-85f2-3ca44f484249" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Lock "cinder-quobyte-48127754-4707-432e-85f2-3ca44f484249" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f6860b-10c7-41de-9265-3f06a87cd96f]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:37 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249 Nov 04 18:55:37 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:37 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c" returned: 0 in 2.428s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_h2hkomfedevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:55:37 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Converted 112.00 MB image at 46.09 MB/s Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:37 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c 1G Nov 04 18:55:37 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:37 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249" returned: 0 in 0.502s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:37 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249 Nov 04 18:55:37 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:37 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c 1G" returned: 0 in 0.417s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Downloaded image 49906b66-c86b-4e49-9cb0-47d303080f8f ((None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}])) to volume d865de7c-ed85-41e2-826d-c231c62feb8c successfully. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Temporary image 49906b66-c86b-4e49-9cb0-47d303080f8f for user 0652fcf9d27d4af6963e63af8c04633f is deleted. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Marking volume d865de7c-ed85-41e2-826d-c231c62feb8c as bootable. {{(pid=87364) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 18:55:37 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-48127754-4707-432e-85f2-3ca44f484249" returned: 0 in 0.329s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Lock "cinder-quobyte-48127754-4707-432e-85f2-3ca44f484249" released by "delete_volume" :: held 0.900s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Copying metadata from image 49906b66-c86b-4e49-9cb0-47d303080f8f to d865de7c-ed85-41e2-826d-c231c62feb8c. {{(pid=87364) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 18:55:37 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Creating volume glance metadata for volume d865de7c-ed85-41e2-826d-c231c62feb8c backed by image 49906b66-c86b-4e49-9cb0-47d303080f8f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87364) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a7a47c48-8fdc-4967-9a20-8dca8e5a8a1d req-06240a92-fbd2-43af-a840-e9102dbe65d5 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a7a47c48-8fdc-4967-9a20-8dca8e5a8a1d req-06240a92-fbd2-43af-a840-e9102dbe65d5 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a7a47c48-8fdc-4967-9a20-8dca8e5a8a1d req-06240a92-fbd2-43af-a840-e9102dbe65d5 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Created reservations ['c25964a1-07c3-43c1-b6a6-2e5aad2b0226', '4ed4bbee-4f95-402c-9903-78c070e6adcf', 'f31837c7-a2c6-4278-b7ff-c3ae50acd533', 'f1a2fa16-d736-42ea-aab2-f23fd493ad7f'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71720307-ef27-4a31-8c37-2ffb25553686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d865de7c-ed85-41e2-826d-c231c62feb8c', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db15e3be-ac34-47fb-939f-d202f54a4b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-a7a47c48-8fdc-4967-9a20-8dca8e5a8a1d req-06240a92-fbd2-43af-a840-e9102dbe65d5 tempest-AttachVolumeTestJSON-1818572539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-bd889751-27f4-4c0e-970f-6740fc3447c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '614cb6ee-c44e-4245-b264-53a5cb3d795b', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:55:38 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Volume volume-d865de7c-ed85-41e2-826d-c231c62feb8c (d865de7c-ed85-41e2-826d-c231c62feb8c): created successfully Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db15e3be-ac34-47fb-939f-d202f54a4b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Flow 'volume_create_manager' (9521cb98-b1f4-4fce-99b5-c8d6f6a7d212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:38 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-76594602-be3a-4b72-91ea-110edbbb5c93 tempest-VolumesExtendTest-130142046 None] Created volume successfully. Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:38 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:55:38 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-a7a47c48-8fdc-4967-9a20-8dca8e5a8a1d req-06240a92-fbd2-43af-a840-e9102dbe65d5 tempest-AttachVolumeTestJSON-1818572539 None] attachment_update completed successfully. Nov 04 18:55:38 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-dd0e31aa-6c0b-407d-9099-df593acbea7a tempest-VolumesExtendTest-130142046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-dd0e31aa-6c0b-407d-9099-df593acbea7a tempest-VolumesExtendTest-130142046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[58197c72-f6f3-46bb-9b18-a078fff3591b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dd0e31aa-6c0b-407d-9099-df593acbea7a tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:38 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.312s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:38 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Deleted volume successfully. Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3434e451-4229-4f73-bddf-dcd25b434abe tempest-AttachVolumeShelveTestJSON-770796833 None] Lock "cinder-48127754-4707-432e-85f2-3ca44f484249-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:38 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c Nov 04 18:55:38 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:38 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dd0e31aa-6c0b-407d-9099-df593acbea7a tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c" returned: 0 in 0.473s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dd0e31aa-6c0b-407d-9099-df593acbea7a tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c 2G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dd0e31aa-6c0b-407d-9099-df593acbea7a tempest-VolumesExtendTest-130142046 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c 2G" returned: 0 in 0.108s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-dd0e31aa-6c0b-407d-9099-df593acbea7a tempest-VolumesExtendTest-130142046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.608s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:39 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-dd0e31aa-6c0b-407d-9099-df593acbea7a tempest-VolumesExtendTest-130142046 None] Extend volume completed successfully. Nov 04 18:55:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Acquiring lock "cinder-d865de7c-ed85-41e2-826d-c231c62feb8c-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Lock "cinder-d865de7c-ed85-41e2-826d-c231c62feb8c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Acquiring lock "cinder-quobyte-d865de7c-ed85-41e2-826d-c231c62feb8c" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Lock "cinder-quobyte-d865de7c-ed85-41e2-826d-c231c62feb8c" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:40 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[36da6b7d-c519-4155-97e4-319e8e495648]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:40 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c Nov 04 18:55:40 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:40 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c" returned: 0 in 0.455s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:40 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c Nov 04 18:55:40 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:41 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d865de7c-ed85-41e2-826d-c231c62feb8c" returned: 0 in 0.362s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Lock "cinder-quobyte-d865de7c-ed85-41e2-826d-c231c62feb8c" released by "delete_volume" :: held 0.905s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Created reservations ['b8f72162-d97d-4628-95eb-0a382ddaf6de', '6847640f-0022-462c-9975-5f9391901a24', '1323ef74-5bc4-432c-a22d-fba5af2afd7b', 'a6fa37ce-a6cf-45bd-8460-c4baa596263b'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-0aa2b420-6c8e-4017-9605-5a7d91056cf8 req-6ad1ccb5-724a-4c18-ac3a-78cc103d8c19 tempest-AttachVolumeTestJSON-1818572539 None] Terminate volume connection completed successfully. Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-0aa2b420-6c8e-4017-9605-5a7d91056cf8 req-6ad1ccb5-724a-4c18-ac3a-78cc103d8c19 tempest-AttachVolumeTestJSON-1818572539 None] Deleting attachment 77957a63-9a6f-4d63-9058-7d9623bfd996. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:41 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:55:41 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:41 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.337s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Deleted volume successfully. Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e778b2c0-3ff0-484e-851a-64f6defe8ec4 tempest-VolumesExtendTest-130142046 None] Lock "cinder-d865de7c-ed85-41e2-826d-c231c62feb8c-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Flow 'volume_create_manager' (754fc79d-d84b-490b-b2dd-10e896089af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd28636-56f7-4728-a8e3-ad115c1cd4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd28636-56f7-4728-a8e3-ad115c1cd4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2046568629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1db5d4-64b3-434e-8553-e2a2d77eeaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1020139280499db13211bc756ff5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:42Z,use_quota=True,user_id='0652fcf9d27d4af6963e63af8c04633f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125e5868-6a88-45d1-8951-084ca2c031a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125e5868-6a88-45d1-8951-084ca2c031a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885efa4c-d00c-4551-8530-c02c161ed186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885efa4c-d00c-4551-8530-c02c161ed186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c1db5d4-64b3-434e-8553-e2a2d77eeaba', 'volume_name': 'volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62ae083-4127-4f8b-ae2b-a7327e7dbf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62ae083-4127-4f8b-ae2b-a7327e7dbf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412238ee-1c42-42c9-b217-e6a8d7756911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:41 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Volume 5c1db5d4-64b3-434e-8553-e2a2d77eeaba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba', 'volume_size': 1} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2046568629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1db5d4-64b3-434e-8553-e2a2d77eeaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1020139280499db13211bc756ff5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:42Z,use_quota=True,user_id='0652fcf9d27d4af6963e63af8c04633f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Creating volume 5c1db5d4-64b3-434e-8553-e2a2d77eeaba {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:41 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:55:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:42 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba 1073741824 Nov 04 18:55:42 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:42 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba 1073741824" returned: 0 in 0.551s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:42 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba Nov 04 18:55:42 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:42 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" returned: 0 in 0.318s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412238ee-1c42-42c9-b217-e6a8d7756911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2f9204-fd55-4d3c-8d02-7d00085622a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-27694627-64da-4c6a-ae17-573375b797d6 req-736fe5ff-ad94-4e17-a020-40c96c26bfe9 tempest-AttachVolumeTestJSON-1818572539 None] Terminate volume connection completed successfully. Nov 04 18:55:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-27694627-64da-4c6a-ae17-573375b797d6 req-736fe5ff-ad94-4e17-a020-40c96c26bfe9 tempest-AttachVolumeTestJSON-1818572539 None] Deleting attachment 614cb6ee-c44e-4245-b264-53a5cb3d795b. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:55:42 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Volume volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba (5c1db5d4-64b3-434e-8553-e2a2d77eeaba): created successfully Nov 04 18:55:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2f9204-fd55-4d3c-8d02-7d00085622a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Flow 'volume_create_manager' (754fc79d-d84b-490b-b2dd-10e896089af3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d4af3f44-8682-487b-a135-cf0ba5c4f199 tempest-VolumesExtendTest-130142046 None] Created volume successfully. Nov 04 18:55:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] Creating offline snapshot f4eafacb-f714-465e-8515-f27ca0d3dd9b of volume 5c1db5d4-64b3-434e-8553-e2a2d77eeaba {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:55:44 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d854c6b2-f853-4871-ad0d-c7289e18ef22]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:44 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba Nov 04 18:55:44 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:45 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" returned: 0 in 0.869s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:45 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b 1G Nov 04 18:55:45 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:46 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b 1G" returned: 0 in 0.662s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:46 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b Nov 04 18:55:46 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:46 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b" returned: 0 in 0.486s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:46 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b is being set with open permissions: ugo+rw Nov 04 18:55:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:46 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b Nov 04 18:55:46 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:47 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b" returned: 0 in 0.467s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:47 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.info Nov 04 18:55:47 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:47 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.info" returned: 0 in 0.325s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:47 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.info is being set with open permissions: ugo+rw Nov 04 18:55:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:47 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.info Nov 04 18:55:47 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:47 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.info" returned: 0 in 0.350s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.369s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:47 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-37dcb3d4-9ed1-43d8-ad97-0afb7482028e tempest-VolumesExtendTest-130142046 None] Create snapshot completed successfully Nov 04 18:55:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "cinder-bd889751-27f4-4c0e-970f-6740fc3447c3-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-bd889751-27f4-4c0e-970f-6740fc3447c3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "cinder-quobyte-bd889751-27f4-4c0e-970f-6740fc3447c3" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54d2813c-6b28-4c1e-87a7-05c47f59a903 tempest-VolumesExtendTest-130142046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54d2813c-6b28-4c1e-87a7-05c47f59a903 tempest-VolumesExtendTest-130142046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-quobyte-bd889751-27f4-4c0e-970f-6740fc3447c3" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:48 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaacf7c-37e1-4cdd-bc1a-24acd59ff443]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54d2813c-6b28-4c1e-87a7-05c47f59a903 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:48 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[03785f56-46a1-4adc-a11e-6d12968a44fb]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:49 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba Nov 04 18:55:49 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:49 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3 Nov 04 18:55:49 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:49 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3" returned: 0 in 0.423s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:49 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54d2813c-6b28-4c1e-87a7-05c47f59a903 tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" returned: 0 in 0.455s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:49 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3 Nov 04 18:55:49 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54d2813c-6b28-4c1e-87a7-05c47f59a903 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b 2G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54d2813c-6b28-4c1e-87a7-05c47f59a903 tempest-VolumesExtendTest-130142046 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b 2G" returned: 0 in 0.174s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54d2813c-6b28-4c1e-87a7-05c47f59a903 tempest-VolumesExtendTest-130142046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.686s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:49 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-54d2813c-6b28-4c1e-87a7-05c47f59a903 tempest-VolumesExtendTest-130142046 None] Extend volume completed successfully. Nov 04 18:55:49 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bd889751-27f4-4c0e-970f-6740fc3447c3" returned: 0 in 0.297s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-quobyte-bd889751-27f4-4c0e-970f-6740fc3447c3" released by "delete_volume" :: held 0.775s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Created reservations ['71546ea1-e286-4428-890a-34594f9900f1', 'be92efa1-4434-4a43-9e1a-851677a2b8a6', 'b1414d33-06c0-4e31-bf4b-4770cb17b799', '004491ff-7962-4734-a6e1-570be02ae153'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:49 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:55:49 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:49 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Flow 'volume_create_manager' (f4f74f18-70b6-404a-b2c5-09d9f7e3ef19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3ae3b9-87b4-44cc-8751-e0d9e71e7941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "cinder-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3ae3b9-87b4-44cc-8751-e0d9e71e7941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1796195454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb52ebe-1a70-4f35-be95-800f5e3c1f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4450fd5a4e4f4a6eb89697313acd97bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:50Z,use_quota=True,user_id='d2dc9abc035043b79fbbc672d0f5cd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce9fd08-5f88-457d-9d5c-84e574c33628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce9fd08-5f88-457d-9d5c-84e574c33628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef50a29a-8a3e-42ec-b559-37deb9d058d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef50a29a-8a3e-42ec-b559-37deb9d058d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fb52ebe-1a70-4f35-be95-800f5e3c1f2f', 'volume_name': 'volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9b5660-2cfd-4aef-a36b-44a58fcdf18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9b5660-2cfd-4aef-a36b-44a58fcdf18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a43945-67da-4fbd-be14-7f919d505047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:50 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Volume 5fb52ebe-1a70-4f35-be95-800f5e3c1f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f', 'volume_size': 1} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1796195454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb52ebe-1a70-4f35-be95-800f5e3c1f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4450fd5a4e4f4a6eb89697313acd97bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:55:50Z,use_quota=True,user_id='d2dc9abc035043b79fbbc672d0f5cd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Creating volume 5fb52ebe-1a70-4f35-be95-800f5e3c1f2f {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:55:50 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:50 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f 1073741824 Nov 04 18:55:50 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "cinder-quobyte-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-quobyte-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:50 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.348s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:50 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Deleted volume successfully. Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Acquiring lock "cinder-f4eafacb-f714-465e-8515-f27ca0d3dd9b-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[99971e0f-d97e-4d3f-9a28-2758ab2e2d25]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ff447bf5-bd2c-409b-ba87-c3314320595a tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-bd889751-27f4-4c0e-970f-6740fc3447c3-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Lock "cinder-f4eafacb-f714-465e-8515-f27ca0d3dd9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Acquiring lock "cinder-quobyte-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Lock "cinder-quobyte-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Acquiring lock "cinder-quobyte-f4eafacb-f714-465e-8515-f27ca0d3dd9b" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Lock "cinder-quobyte-f4eafacb-f714-465e-8515-f27ca0d3dd9b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Deleting offline snapshot f4eafacb-f714-465e-8515-f27ca0d3dd9b of volume 5c1db5d4-64b3-434e-8553-e2a2d77eeaba {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] snapshot_file for this snap is: volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cd766b-8b7b-47a0-8e4d-3c41c33a3129]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:50 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff Nov 04 18:55:50 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:50 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b Nov 04 18:55:50 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:50 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f 1073741824" returned: 0 in 0.536s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:50 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff" returned: 0 in 0.468s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:50 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f Nov 04 18:55:50 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:50 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff Nov 04 18:55:50 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:50 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b" returned: 0 in 0.460s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[462f91de-cd4f-4cbc-84c8-302e3f04de7d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:51 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba Nov 04 18:55:51 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:51 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f" returned: 0 in 0.320s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:51 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a43945-67da-4fbd-be14-7f919d505047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4123124-43b5-415a-85f8-b239edb51214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff" returned: 0 in 0.325s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-quobyte-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff" released by "delete_volume" :: held 0.873s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:51 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Volume volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f (5fb52ebe-1a70-4f35-be95-800f5e3c1f2f): created successfully Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4123124-43b5-415a-85f8-b239edb51214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Flow 'volume_create_manager' (f4f74f18-70b6-404a-b2c5-09d9f7e3ef19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:55:51 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-b3dd4dc6-7021-4ad8-8316-bf6eb7059af5 req-5dbb5fdf-a9da-4186-addb-ed710854a889 tempest-VolumesSnapshotsTestJSON-960191192 None] Created volume successfully. Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Created reservations ['9e07a266-b5d1-49ce-8b46-06066b39f2e7', '807809eb-90ca-4346-8e18-043a8364772e', '956e5503-85eb-449b-b664-29a72274d386', 'a4a2d666-401c-4640-96ad-2ef80152c266'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:51 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:55:51 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:51 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" returned: 0 in 0.417s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:51 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b Nov 04 18:55:51 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:51 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.277s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:51 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Deleted volume successfully. Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e6f4b8ad-e0a2-4361-97ca-222ebc81a9a8 tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-68e2f4fd-7eea-42cf-bb4b-f7f11fcdbcff-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:51 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b" returned: 0 in 0.380s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:51 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b Nov 04 18:55:51 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:51 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba.f4eafacb-f714-465e-8515-f27ca0d3dd9b" returned: 0 in 0.266s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Lock "cinder-quobyte-f4eafacb-f714-465e-8515-f27ca0d3dd9b" released by "_delete_snapshot" :: held 1.660s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Lock "cinder-quobyte-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" released by "delete_snapshot" :: held 1.687s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Created reservations ['2111c37d-6333-41a7-b220-b829e87a7ab4', '22577765-4e95-4152-a7c3-fe9feac37c3f', '5b9797d2-3ed8-4c5d-8e08-2b5dfd9b3aad', '1c1c17ea-f093-4fde-a7fd-2c3457ef04ca'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:52 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Delete snapshot completed successfully. Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1d9f58d3-aaf7-4c14-a7f3-684aa2368c5c tempest-VolumesExtendTest-130142046 None] Lock "cinder-f4eafacb-f714-465e-8515-f27ca0d3dd9b-delete_snapshot" released by "delete_snapshot" :: held 1.850s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] Creating offline snapshot 9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 of volume 5fb52ebe-1a70-4f35-be95-800f5e3c1f2f {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "cinder-1a4bc52c-eff3-4dde-8984-7acaf35c5099-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[90607406-57c2-4f29-b421-f09c894c2fa9]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-1a4bc52c-eff3-4dde-8984-7acaf35c5099-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "cinder-quobyte-1a4bc52c-eff3-4dde-8984-7acaf35c5099" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-quobyte-1a4bc52c-eff3-4dde-8984-7acaf35c5099" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Acquiring lock "cinder-5c1db5d4-64b3-434e-8553-e2a2d77eeaba-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c045d9-e073-4cc7-84bb-084a647e0971]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Lock "cinder-5c1db5d4-64b3-434e-8553-e2a2d77eeaba-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:52 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f Nov 04 18:55:52 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Acquiring lock "cinder-quobyte-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Lock "cinder-quobyte-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" acquired by "delete_volume" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:52 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099 Nov 04 18:55:52 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d8bbac-98e5-424b-9d86-1c8a7f1bf09b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:52 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba Nov 04 18:55:52 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:52 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f" returned: 0 in 0.508s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:53 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 1G Nov 04 18:55:53 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:53 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099" returned: 0 in 0.455s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:53 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099 Nov 04 18:55:53 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:53 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" returned: 0 in 0.419s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:53 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba Nov 04 18:55:53 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:53 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1a4bc52c-eff3-4dde-8984-7acaf35c5099" returned: 0 in 0.289s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-quobyte-1a4bc52c-eff3-4dde-8984-7acaf35c5099" released by "delete_volume" :: held 0.819s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:53 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 1G" returned: 0 in 0.449s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Created reservations ['61f7e437-33d8-4c87-86b8-2c8326fa3194', '28ed0e61-dad6-4796-ada6-ccb992d25689', 'aae7d6d1-2123-40dd-920c-cb36d4cf5cb9', 'f05c6259-c267-4f6d-9dcf-920c02839da1'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:53 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 Nov 04 18:55:53 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:53 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" returned: 0 in 0.298s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Lock "cinder-quobyte-5c1db5d4-64b3-434e-8553-e2a2d77eeaba" released by "delete_volume" :: held 0.820s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:53 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:55:53 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Created reservations ['00d4437b-a2ae-4fb5-b510-00b9510dfcf4', '9810e1c6-cf73-49e7-ba43-f922fe970ccf', 'f41d7b47-d89b-4c5f-aa05-b508e7068460', '124366a1-8cf7-47a6-b134-ad2a0b8905de'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:53 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:55:53 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:53 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8" returned: 0 in 0.451s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:53 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 is being set with open permissions: ugo+rw Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:53 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 Nov 04 18:55:53 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:53 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.407s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:53 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:53 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Deleted volume successfully. Nov 04 18:55:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8aee798c-1dd4-40f8-85ee-7536f7a1db74 tempest-AttachVolumeTestJSON-1818572539 None] Lock "cinder-1a4bc52c-eff3-4dde-8984-7acaf35c5099-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:54 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.411s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:54 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:55:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Deleted volume successfully. Nov 04 18:55:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fd13ba84-12d0-4ba3-822f-cc2dd0e50813 tempest-VolumesExtendTest-130142046 None] Lock "cinder-5c1db5d4-64b3-434e-8553-e2a2d77eeaba-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:54 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8" returned: 0 in 0.315s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:54 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.info Nov 04 18:55:54 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:54 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.info" returned: 0 in 0.316s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:54 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.info is being set with open permissions: ugo+rw Nov 04 18:55:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:54 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.info Nov 04 18:55:54 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:54 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.info" returned: 0 in 0.330s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.519s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-90a7510e-46c3-40c1-bbe2-e961ededc36b req-422998f6-1ccd-47c5-b229-a4ece78c344f tempest-VolumesSnapshotsTestJSON-960191192 None] Create snapshot completed successfully Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Acquiring lock "cinder-9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "cinder-9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Acquiring lock "cinder-quobyte-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "cinder-quobyte-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Acquiring lock "cinder-quobyte-9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "cinder-quobyte-9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Deleting offline snapshot 9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 of volume 5fb52ebe-1a70-4f35-be95-800f5e3c1f2f {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] snapshot_file for this snap is: volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e63215-8b6f-410d-bbbb-75ef61b617a5]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:56 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 Nov 04 18:55:56 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:56 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8" returned: 0 in 0.462s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49c46e7-3810-4809-b572-aade95eeb53d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:56 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f Nov 04 18:55:56 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f" returned: 0 in 0.474s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:57 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:57 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 Nov 04 18:55:57 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:57 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8" returned: 0 in 0.418s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:57 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8 Nov 04 18:55:57 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:57 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f.9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8" returned: 0 in 0.292s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "cinder-quobyte-9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8" released by "_delete_snapshot" :: held 1.811s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "cinder-quobyte-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f" released by "delete_snapshot" :: held 1.842s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:58 devstack cinder-volume[87364]: DEBUG cinder.quota [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Created reservations ['afe62c0d-49fb-4deb-ac93-741d48c8e3cd', '4b9d8eca-994c-4b7d-b253-0696d6ff9035', '30273ac4-57e2-412b-9ea6-a3d3f11b6bd5', '2f94331d-62c3-4d60-b89d-a6f3c63abc01'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:58 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Delete snapshot completed successfully. Nov 04 18:55:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-e1318ec0-377d-4922-9dc7-8dfa445a2ae5 req-adc0380c-be34-4904-bb33-278bcd45ed28 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "cinder-9ee65be5-a27d-4ea8-909c-7a9f2d8b1ac8-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Acquiring lock "cinder-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "cinder-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Acquiring lock "cinder-quobyte-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:55:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "cinder-quobyte-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:55:58 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d157cde3-7334-4797-9ec8-becaee643c69]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:55:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:58 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f Nov 04 18:55:58 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:59 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f" returned: 0 in 0.485s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:59 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f Nov 04 18:55:59 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:55:59 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Nov 04 18:55:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f" returned: 0 in 0.302s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:55:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "cinder-quobyte-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f" released by "delete_volume" :: held 0.902s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:55:59 devstack cinder-volume[87364]: DEBUG cinder.quota [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Created reservations ['f55ab933-5874-4ae1-9046-6b608373c2de', '37abfbbb-08ee-435e-9f27-a950019cf394', '300917ea-3018-4bbb-bc4e-99b1a932f636', '3d04ccf8-7825-4deb-8b85-38f4f8286029'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:55:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:55:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:55:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:55:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:55:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:55:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:55:59 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:55:59 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:00 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.336s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:00 devstack cinder-volume[87364]: DEBUG cinder.manager [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:00 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Deleted volume successfully. Nov 04 18:56:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-a7e45c3e-dbc6-4cae-af22-4fa5d9de633f req-9e085b14-8430-4d25-8f12-7603dae4a8a8 tempest-VolumesSnapshotsTestJSON-960191192 None] Lock "cinder-5fb52ebe-1a70-4f35-be95-800f5e3c1f2f-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-602907c5-1ee8-4f45-8990-89fd2477c5b4 req-5742372f-9585-4251-bb4a-abb397b8cb38 tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-602907c5-1ee8-4f45-8990-89fd2477c5b4 req-5742372f-9585-4251-bb4a-abb397b8cb38 tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-602907c5-1ee8-4f45-8990-89fd2477c5b4 req-5742372f-9585-4251-bb4a-abb397b8cb38 tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-602907c5-1ee8-4f45-8990-89fd2477c5b4 req-5742372f-9585-4251-bb4a-abb397b8cb38 tempest-ServerActionsTestOtherA-510348025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-bca4f364-44c7-420a-a6db-d09ed6170e32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19b1ed37-d624-41f2-a509-ef57eafc612b', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:56:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-602907c5-1ee8-4f45-8990-89fd2477c5b4 req-5742372f-9585-4251-bb4a-abb397b8cb38 tempest-ServerActionsTestOtherA-510348025 None] attachment_update completed successfully. Nov 04 18:56:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-aa7d76ac-bd88-4b70-87af-110058af5c2a tempest-BackendsCapabilitiesAdminTestsJSON-1126249081 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5831718444824, 'free_capacity_gb': 1773.5831718444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87364) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 18:56:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9c58c77b-6b2f-4ac2-9f9c-4fce7f864081 tempest-BackendsCapabilitiesAdminTestsJSON-1126249081 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5831718444824, 'free_capacity_gb': 1773.5831718444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87364) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 18:56:08 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-9cd7f788-5268-440c-aa72-1951ddbb590b req-71bf0325-eb46-43a9-bfe9-310e630eb67d tempest-ServerActionsTestOtherA-510348025 None] Terminate volume connection completed successfully. Nov 04 18:56:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-9cd7f788-5268-440c-aa72-1951ddbb590b req-71bf0325-eb46-43a9-bfe9-310e630eb67d tempest-ServerActionsTestOtherA-510348025 None] Deleting attachment 19b1ed37-d624-41f2-a509-ef57eafc612b. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:56:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-9cd7f788-5268-440c-aa72-1951ddbb590b req-b7e30050-df07-4b21-ad02-a61450c35ef4 tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-9cd7f788-5268-440c-aa72-1951ddbb590b req-b7e30050-df07-4b21-ad02-a61450c35ef4 tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-9cd7f788-5268-440c-aa72-1951ddbb590b req-b7e30050-df07-4b21-ad02-a61450c35ef4 tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-9cd7f788-5268-440c-aa72-1951ddbb590b req-b7e30050-df07-4b21-ad02-a61450c35ef4 tempest-ServerActionsTestOtherA-510348025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-bca4f364-44c7-420a-a6db-d09ed6170e32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '566091db-74f3-4cd0-924e-90124d51967d', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:56:10 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-9cd7f788-5268-440c-aa72-1951ddbb590b req-b7e30050-df07-4b21-ad02-a61450c35ef4 tempest-ServerActionsTestOtherA-510348025 None] attachment_update completed successfully. Nov 04 18:56:14 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Flow 'volume_create_manager' (b9609fe6-6640-4078-ab5b-93f3fc462df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8f6809-5ad7-4cec-a4d2-40d5c857bb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8f6809-5ad7-4cec-a4d2-40d5c857bb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2020422351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd48b94d-052c-487e-9b14-64e0141de182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b670cef6064da3aaa0c4046dd8bda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:15Z,use_quota=True,user_id='a4149e4e53c34d348e0542374eb83b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f168fc01-d43f-4625-a4c7-b1ba0c883cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f168fc01-d43f-4625-a4c7-b1ba0c883cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c23d8c-eb41-4089-bb81-d1c01603d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c23d8c-eb41-4089-bb81-d1c01603d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd48b94d-052c-487e-9b14-64e0141de182', 'volume_name': 'volume-dd48b94d-052c-487e-9b14-64e0141de182', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e25e49-e2ba-493e-a537-c6ec209a5374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e25e49-e2ba-493e-a537-c6ec209a5374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9c4a66-58e4-4442-a42a-252851140885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:15 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume dd48b94d-052c-487e-9b14-64e0141de182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd48b94d-052c-487e-9b14-64e0141de182', 'volume_size': 1} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2020422351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd48b94d-052c-487e-9b14-64e0141de182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b670cef6064da3aaa0c4046dd8bda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:15Z,use_quota=True,user_id='a4149e4e53c34d348e0542374eb83b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Creating volume dd48b94d-052c-487e-9b14-64e0141de182 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:15 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:56:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:15 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 1073741824 Nov 04 18:56:15 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:16 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 1073741824" returned: 0 in 0.951s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:16 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:56:16 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:16 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 Nov 04 18:56:16 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:16 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.575s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:56:16 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182" returned: 0 in 0.643s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9c4a66-58e4-4442-a42a-252851140885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd48b94d-052c-487e-9b14-64e0141de182', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affce394-3a3a-438a-a2ea-eceef3b2c147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:16 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume volume-dd48b94d-052c-487e-9b14-64e0141de182 (dd48b94d-052c-487e-9b14-64e0141de182): created successfully Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affce394-3a3a-438a-a2ea-eceef3b2c147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Flow 'volume_create_manager' (b9609fe6-6640-4078-ab5b-93f3fc462df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:16 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-09995734-3a03-4610-af4e-3ec8c941d827 tempest-VolumesSnapshotTestJSON-1538794110 None] Created volume successfully. Nov 04 18:56:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] Creating offline snapshot 07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 of volume dd48b94d-052c-487e-9b14-64e0141de182 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:56:18 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36afc65-158d-44db-b660-b9cb60b1b271]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:18 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 Nov 04 18:56:18 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:18 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182" returned: 0 in 0.599s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:18 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 1G Nov 04 18:56:18 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:19 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 1G" returned: 0 in 0.787s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd48b94d-052c-487e-9b14-64e0141de182 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:19 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd48b94d-052c-487e-9b14-64e0141de182 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 Nov 04 18:56:19 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:19 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd48b94d-052c-487e-9b14-64e0141de182 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050" returned: 0 in 0.460s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:19 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 is being set with open permissions: ugo+rw Nov 04 18:56:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:19 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 Nov 04 18:56:19 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:20 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050" returned: 0 in 0.357s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:20 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.info Nov 04 18:56:20 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:20 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.info" returned: 0 in 0.530s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:20 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.info is being set with open permissions: ugo+rw Nov 04 18:56:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:20 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.info Nov 04 18:56:20 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:21 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.info" returned: 0 in 0.381s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.302s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:21 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-bfbe55e9-19bb-434c-ac50-5e74e754a3ec tempest-VolumesSnapshotTestJSON-1538794110 None] Create snapshot completed successfully Nov 04 18:56:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-07a3a5c5-aff8-49c2-b1a3-1cd1e8487050-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-07a3a5c5-aff8-49c2-b1a3-1cd1e8487050-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-dd48b94d-052c-487e-9b14-64e0141de182" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-dd48b94d-052c-487e-9b14-64e0141de182" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-07a3a5c5-aff8-49c2-b1a3-1cd1e8487050" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-07a3a5c5-aff8-49c2-b1a3-1cd1e8487050" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Deleting offline snapshot 07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 of volume dd48b94d-052c-487e-9b14-64e0141de182 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:56:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] snapshot_file for this snap is: volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:56:22 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f26857f-02dc-4a06-822e-8e050931dea6]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:23 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 Nov 04 18:56:23 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:23 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050" returned: 0 in 0.563s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd48b94d-052c-487e-9b14-64e0141de182(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:56:23 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[898d2066-8efb-4f59-8171-b71e2848e87a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:23 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 Nov 04 18:56:23 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:24 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182" returned: 0 in 0.666s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:24 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 Nov 04 18:56:24 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:24 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050" returned: 0 in 0.419s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:24 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050 Nov 04 18:56:24 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:24 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182.07a3a5c5-aff8-49c2-b1a3-1cd1e8487050" returned: 0 in 0.365s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-07a3a5c5-aff8-49c2-b1a3-1cd1e8487050" released by "_delete_snapshot" :: held 2.183s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-dd48b94d-052c-487e-9b14-64e0141de182" released by "delete_snapshot" :: held 2.237s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:25 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Created reservations ['7054f839-5626-45c0-8183-5b14855b6563', 'acb54c74-1e94-4dfe-a36c-4562dba3dd62', '06a1a4fd-f5f3-499b-a7ab-279ac8da8f90', '85ccac92-4f8c-4893-a2c3-c39171c76a49'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:25 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Delete snapshot completed successfully. Nov 04 18:56:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dabb5359-1830-4b9a-973e-116325e67cce tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-07a3a5c5-aff8-49c2-b1a3-1cd1e8487050-delete_snapshot" released by "delete_snapshot" :: held 2.643s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:26 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4372a3d9-06d3-4ebc-879c-e75f375c5ade tempest-GroupsTest-753114618 None] Group tempest-Group1-711681329: creating Nov 04 18:56:26 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4372a3d9-06d3-4ebc-879c-e75f375c5ade tempest-GroupsTest-753114618 None] Group tempest-Group1-711681329: created successfully Nov 04 18:56:26 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4372a3d9-06d3-4ebc-879c-e75f375c5ade tempest-GroupsTest-753114618 None] Create group completed successfully. Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Flow 'volume_create_manager' (9d16046f-910a-4309-90f0-cc4e68d664aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1484355-65b8-45d9-88b1-906e7148313e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1484355-65b8-45d9-88b1-906e7148313e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1123840039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd3f268-f0b8-48fe-9db6-d379dce3940e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b670cef6064da3aaa0c4046dd8bda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:27Z,use_quota=True,user_id='a4149e4e53c34d348e0542374eb83b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fcf098-1ece-485a-b2a7-b3e63c7a074c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30fcf098-1ece-485a-b2a7-b3e63c7a074c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4a6822-c07d-431a-9572-ccdf904ebdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4a6822-c07d-431a-9572-ccdf904ebdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd3f268-f0b8-48fe-9db6-d379dce3940e', 'volume_name': 'volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4ec47d-fb35-4289-a1f5-e973b04caadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e4ec47d-fb35-4289-a1f5-e973b04caadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c71b3c-8325-47a0-9e8a-004962c6d157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:26 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume dcd3f268-f0b8-48fe-9db6-d379dce3940e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e', 'volume_size': 1} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1123840039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd3f268-f0b8-48fe-9db6-d379dce3940e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b670cef6064da3aaa0c4046dd8bda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:27Z,use_quota=True,user_id='a4149e4e53c34d348e0542374eb83b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Creating volume dcd3f268-f0b8-48fe-9db6-d379dce3940e {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:26 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:56:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:26 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e 1073741824 Nov 04 18:56:26 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:27 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e 1073741824" returned: 0 in 0.625s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:27 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e Nov 04 18:56:27 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:27 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-bc78cf4a-f944-45a5-960e-b0f5315f1b1d tempest-GroupsTest-753114618 None] Group tempest-Group2-954386381: creating Nov 04 18:56:27 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-bc78cf4a-f944-45a5-960e-b0f5315f1b1d tempest-GroupsTest-753114618 None] Group tempest-Group2-954386381: created successfully Nov 04 18:56:27 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-bc78cf4a-f944-45a5-960e-b0f5315f1b1d tempest-GroupsTest-753114618 None] Create group completed successfully. Nov 04 18:56:27 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e" returned: 0 in 0.406s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:27 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=97,cinder:DELETE=9,cinder:SELECT=135,cinder:INSERT=36 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:56:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c71b3c-8325-47a0-9e8a-004962c6d157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404ac29a-b698-420c-b04e-ef22ff9586d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:28 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e (dcd3f268-f0b8-48fe-9db6-d379dce3940e): created successfully Nov 04 18:56:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404ac29a-b698-420c-b04e-ef22ff9586d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Flow 'volume_create_manager' (9d16046f-910a-4309-90f0-cc4e68d664aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:28 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-48326657-e8b5-4bbc-b89c-073640b92d30 tempest-VolumesSnapshotTestJSON-1538794110 None] Created volume successfully. Nov 04 18:56:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] Creating offline snapshot 824ed921-8048-4af2-86bd-afaf07c659a6 of volume dcd3f268-f0b8-48fe-9db6-d379dce3940e {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:56:29 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5924580a-307d-47e8-9133-a440d212d522]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:29 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e Nov 04 18:56:29 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:29 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Flow 'volume_create_manager' (57d3ff6b-1e06-4ba0-aca9-c42f7a64a8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47397373-72ad-48e3-a823-e73ed2670c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47397373-72ad-48e3-a823-e73ed2670c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-838993412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7bcd0348-ff0c-4d1b-9bf2-a95061a8fcac,host='devstack@QuobyteHD#QuobyteHD',id=b42b83c6-58f1-418a-aaca-1aff94a18be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee52901a5732403cbe9f3146ac687022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:30Z,use_quota=True,user_id='a8908d0187024a508111da949b220d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43757d8c-8db7-4edc-8228-bef68ad83f23),volume_type_id=43757d8c-8db7-4edc-8228-bef68ad83f23)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72608e8f-2457-4bd7-9d43-550ab82bd720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72608e8f-2457-4bd7-9d43-550ab82bd720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebab0880-df79-4cbb-860d-ea9b9345cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebab0880-df79-4cbb-860d-ea9b9345cd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b42b83c6-58f1-418a-aaca-1aff94a18be0', 'volume_name': 'volume-b42b83c6-58f1-418a-aaca-1aff94a18be0', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bf0216-e9fb-4e32-94ac-62a3ed226273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bf0216-e9fb-4e32-94ac-62a3ed226273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6cec2b-b01a-4c0b-b946-e93cd4035a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:30 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Volume b42b83c6-58f1-418a-aaca-1aff94a18be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b42b83c6-58f1-418a-aaca-1aff94a18be0', 'volume_size': 1} Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:30 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e" returned: 0 in 0.799s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:30 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 1G Nov 04 18:56:30 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:30 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 1G" returned: 0 in 0.464s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:30 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 Nov 04 18:56:30 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:30 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6" returned: 0 in 0.329s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:30 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 is being set with open permissions: ugo+rw Nov 04 18:56:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:30 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 Nov 04 18:56:30 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:31 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6" returned: 0 in 0.277s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=112,cinder:UPDATE=125,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:31 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.info Nov 04 18:56:31 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:31 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.info" returned: 0 in 0.301s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:31 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.info is being set with open permissions: ugo+rw Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:31 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.info Nov 04 18:56:31 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:31 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.info" returned: 0 in 0.297s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.762s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7bcd0348-ff0c-4d1b-9bf2-a95061a8fcac,created_at=2026-11-04T17:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-838993412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7bcd0348-ff0c-4d1b-9bf2-a95061a8fcac,host='devstack@QuobyteHD#QuobyteHD',id=b42b83c6-58f1-418a-aaca-1aff94a18be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee52901a5732403cbe9f3146ac687022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:30Z,use_quota=True,user_id='a8908d0187024a508111da949b220d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43757d8c-8db7-4edc-8228-bef68ad83f23),volume_type_id=43757d8c-8db7-4edc-8228-bef68ad83f23)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Creating volume b42b83c6-58f1-418a-aaca-1aff94a18be0 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:31 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:56:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:31 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0 1073741824 Nov 04 18:56:31 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:31 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e47f31c3-1385-4f9c-bad4-28ada723806c tempest-VolumesSnapshotTestJSON-1538794110 None] Create snapshot completed successfully Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0 1073741824" returned: 0 in 1.233s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:33 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:33 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0 Nov 04 18:56:33 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:33 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0" returned: 0 in 0.342s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6cec2b-b01a-4c0b-b946-e93cd4035a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42b83c6-58f1-418a-aaca-1aff94a18be0', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195c6f62-d484-4164-89f9-d4c288bc6bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:33 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Volume volume-b42b83c6-58f1-418a-aaca-1aff94a18be0 (b42b83c6-58f1-418a-aaca-1aff94a18be0): created successfully Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195c6f62-d484-4164-89f9-d4c288bc6bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Flow 'volume_create_manager' (57d3ff6b-1e06-4ba0-aca9-c42f7a64a8af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a894776c-527c-4175-91f2-c488fc054756 tempest-GroupsTest-753114618 None] Created volume successfully. Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Flow 'volume_create_manager' (26d9997c-e746-4efa-a957-c541dd727d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d069fc4-fe0e-4885-825c-505451ab96a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d069fc4-fe0e-4885-825c-505451ab96a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-138825395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35df214-b239-4071-a75c-cdd465e17812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b670cef6064da3aaa0c4046dd8bda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=824ed921-8048-4af2-86bd-afaf07c659a6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:34Z,use_quota=True,user_id='a4149e4e53c34d348e0542374eb83b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02eb7da5-3841-4919-9638-aa224f99e984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02eb7da5-3841-4919-9638-aa224f99e984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d17e4c-981f-4b21-89c4-66f6c4214194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d17e4c-981f-4b21-89c4-66f6c4214194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e35df214-b239-4071-a75c-cdd465e17812', 'volume_name': 'volume-e35df214-b239-4071-a75c-cdd465e17812', 'volume_size': 2, 'snapshot_id': '824ed921-8048-4af2-86bd-afaf07c659a6'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3806a779-7514-4501-b88a-5986ff191197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3806a779-7514-4501-b88a-5986ff191197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e08c679-5138-4e1a-abed-163891027dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:33 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Volume e35df214-b239-4071-a75c-cdd465e17812: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e35df214-b239-4071-a75c-cdd465e17812', 'volume_size': 2, 'snapshot_id': '824ed921-8048-4af2-86bd-afaf07c659a6'} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-824ed921-8048-4af2-86bd-afaf07c659a6-e35df214-b239-4071-a75c-cdd465e17812" by "_create_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-824ed921-8048-4af2-86bd-afaf07c659a6-e35df214-b239-4071-a75c-cdd465e17812" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Creating volume e35df214-b239-4071-a75c-cdd465e17812 from snapshot 824ed921-8048-4af2-86bd-afaf07c659a6 {{(pid=87364) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-e35df214-b239-4071-a75c-cdd465e17812" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-e35df214-b239-4071-a75c-cdd465e17812" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] snapshot: 824ed921-8048-4af2-86bd-afaf07c659a6, volume: e35df214-b239-4071-a75c-cdd465e17812, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 18:56:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:34 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e75547-5960-434e-a004-68674746842b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:34 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 Nov 04 18:56:34 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:34 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6" returned: 0 in 0.633s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:56:34 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca59eefd-ffab-4588-9013-f4a6cbeefebd]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:34 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e Nov 04 18:56:34 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:35 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e" returned: 0 in 0.564s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 18:56:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 18:56:35 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812 not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 18:56:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:35 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812 Nov 04 18:56:35 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Acquiring lock "cinder-quobyte-b42b83c6-58f1-418a-aaca-1aff94a18be0" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Lock "cinder-quobyte-b42b83c6-58f1-418a-aaca-1aff94a18be0" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:36 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb5afbd-dfb2-4ccd-aa89-d0515e79d17c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:36 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0 Nov 04 18:56:36 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:37 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0" returned: 0 in 1.449s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:37 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0 Nov 04 18:56:37 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:38 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b42b83c6-58f1-418a-aaca-1aff94a18be0" returned: 0 in 0.854s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Lock "cinder-quobyte-b42b83c6-58f1-418a-aaca-1aff94a18be0" released by "delete_volume" :: held 2.450s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:38 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Created reservations ['ca82b509-6a25-49d9-8b58-0261a88d1911'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:39 devstack cinder-volume[87364]: WARNING cinder.quota [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1952156016 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1952156016, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:56:39 devstack cinder-volume[87364]: WARNING cinder.quota [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1952156016 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1952156016, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:56:39 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Created reservations ['556c12f1-1412-4180-ade1-822c04adbed1', '2d35d18f-29fc-4c1a-836b-3181780acc31', '08bc2eeb-ebc7-45d8-8770-4c9b0e0471d2', '542c7fa5-be1b-4484-8fff-d181f4dbb756'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:39 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:56:39 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 1.085s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:40 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:40 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:40 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-07def309-04de-495c-b606-beb3579194c5 tempest-GroupsTest-753114618 None] Delete group completed successfully. Nov 04 18:56:41 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-4e61225f-0c77-44bb-bd2a-22a04a2eefe6 tempest-GroupsTest-753114618 None] Created reservations ['2925d1e8-64be-4ace-acb2-ecadb47cf117'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4e61225f-0c77-44bb-bd2a-22a04a2eefe6 tempest-GroupsTest-753114618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4e61225f-0c77-44bb-bd2a-22a04a2eefe6 tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4e61225f-0c77-44bb-bd2a-22a04a2eefe6 tempest-GroupsTest-753114618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4e61225f-0c77-44bb-bd2a-22a04a2eefe6 tempest-GroupsTest-753114618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4e61225f-0c77-44bb-bd2a-22a04a2eefe6 tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4e61225f-0c77-44bb-bd2a-22a04a2eefe6 tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:41 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:56:41 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:42 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4e61225f-0c77-44bb-bd2a-22a04a2eefe6 tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 1.091s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:42 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-4e61225f-0c77-44bb-bd2a-22a04a2eefe6 tempest-GroupsTest-753114618 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4e61225f-0c77-44bb-bd2a-22a04a2eefe6 tempest-GroupsTest-753114618 None] Delete group completed successfully. Nov 04 18:56:43 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-04853d16-7583-4f6a-97dd-db7149792d51 req-222f0310-3e7e-4114-b99e-35c092638cc1 tempest-ServerActionsTestOtherA-510348025 None] Terminate volume connection completed successfully. Nov 04 18:56:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-04853d16-7583-4f6a-97dd-db7149792d51 req-222f0310-3e7e-4114-b99e-35c092638cc1 tempest-ServerActionsTestOtherA-510348025 None] Deleting attachment 566091db-74f3-4cd0-924e-90124d51967d. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:56:44 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-89d5656e-8edf-471b-ba73-001661f0cbc8 tempest-GroupsTest-753114618 None] Group tempest-GroupsTest-Group-930700170: creating Nov 04 18:56:44 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-89d5656e-8edf-471b-ba73-001661f0cbc8 tempest-GroupsTest-753114618 None] Group tempest-GroupsTest-Group-930700170: created successfully Nov 04 18:56:44 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-89d5656e-8edf-471b-ba73-001661f0cbc8 tempest-GroupsTest-753114618 None] Create group completed successfully. Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Flow 'volume_create_manager' (ecd6ad08-ed7c-4d6c-a83b-8e9ef1ed53c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb20dd1-75e8-4562-9d9a-8cc8277814bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb20dd1-75e8-4562-9d9a-8cc8277814bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-45199588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9673253c-5aa2-4372-97da-62b836403c38,host='devstack@QuobyteHD#QuobyteHD',id=71cded3b-44ee-444f-8377-d30f8c795d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee52901a5732403cbe9f3146ac687022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:47Z,use_quota=True,user_id='a8908d0187024a508111da949b220d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(122469a5-1c32-44a3-aa3d-0280e18a4c51),volume_type_id=122469a5-1c32-44a3-aa3d-0280e18a4c51)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca20ccd-9326-4585-a79d-2ae09d5861be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca20ccd-9326-4585-a79d-2ae09d5861be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12be3cc-0ab8-488d-a242-8d0b6ab9ecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12be3cc-0ab8-488d-a242-8d0b6ab9ecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71cded3b-44ee-444f-8377-d30f8c795d4a', 'volume_name': 'volume-71cded3b-44ee-444f-8377-d30f8c795d4a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9e9b00-3d47-407f-9446-7ab86aa0cec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9e9b00-3d47-407f-9446-7ab86aa0cec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90625be-974d-4ac7-9357-128f9d3a3ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:47 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Volume 71cded3b-44ee-444f-8377-d30f8c795d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71cded3b-44ee-444f-8377-d30f8c795d4a', 'volume_size': 1} Nov 04 18:56:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:48 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812" returned: 0 in 13.142s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e, size 1024.00 MB, duration 13.14 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:56:48 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Converted 1024.00 MB image at 77.91 MB/s Nov 04 18:56:48 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812 is being set with open permissions: ugo+rw Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:48 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812 Nov 04 18:56:48 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:48 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812" returned: 0 in 0.291s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-e35df214-b239-4071-a75c-cdd465e17812" released by "_copy_volume_from_snapshot" :: held 14.814s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-824ed921-8048-4af2-86bd-afaf07c659a6-e35df214-b239-4071-a75c-cdd465e17812" released by "_create_volume_from_snapshot" :: held 14.911s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.936s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.871s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9673253c-5aa2-4372-97da-62b836403c38,created_at=2026-11-04T17:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-45199588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9673253c-5aa2-4372-97da-62b836403c38,host='devstack@QuobyteHD#QuobyteHD',id=71cded3b-44ee-444f-8377-d30f8c795d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee52901a5732403cbe9f3146ac687022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:47Z,use_quota=True,user_id='a8908d0187024a508111da949b220d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(122469a5-1c32-44a3-aa3d-0280e18a4c51),volume_type_id=122469a5-1c32-44a3-aa3d-0280e18a4c51)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Creating volume 71cded3b-44ee-444f-8377-d30f8c795d4a {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:48 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:48 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a 1073741824 Nov 04 18:56:48 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e08c679-5138-4e1a-abed-163891027dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35df214-b239-4071-a75c-cdd465e17812', 'volume_size': 2, 'snapshot_id': '824ed921-8048-4af2-86bd-afaf07c659a6'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e04f8a-0208-4bc0-8f48-0a51bf8dc967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:48 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Volume volume-e35df214-b239-4071-a75c-cdd465e17812 (e35df214-b239-4071-a75c-cdd465e17812): created successfully Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e04f8a-0208-4bc0-8f48-0a51bf8dc967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Flow 'volume_create_manager' (26d9997c-e746-4efa-a957-c541dd727d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:48 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-abb868e8-b6f9-4f2f-ab77-90db1c6f6d8d tempest-VolumesSnapshotTestJSON-1538794110 None] Created volume successfully. Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-e35df214-b239-4071-a75c-cdd465e17812-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-e35df214-b239-4071-a75c-cdd465e17812-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-e35df214-b239-4071-a75c-cdd465e17812" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-e35df214-b239-4071-a75c-cdd465e17812" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:49 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a 1073741824" returned: 0 in 0.666s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eb66d1-addd-4c20-b27f-e81c9412ac42]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:49 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a Nov 04 18:56:49 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:49 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812 Nov 04 18:56:49 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:49 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a" returned: 0 in 0.381s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90625be-974d-4ac7-9357-128f9d3a3ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71cded3b-44ee-444f-8377-d30f8c795d4a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577839d2-5107-4d57-bad4-f6cc7b503afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:49 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Volume volume-71cded3b-44ee-444f-8377-d30f8c795d4a (71cded3b-44ee-444f-8377-d30f8c795d4a): created successfully Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577839d2-5107-4d57-bad4-f6cc7b503afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Flow 'volume_create_manager' (ecd6ad08-ed7c-4d6c-a83b-8e9ef1ed53c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:49 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812" returned: 0 in 0.513s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:50 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f46d0e0e-ac1b-49ba-8ff8-8a2fc218ed7f tempest-GroupsTest-753114618 None] Created volume successfully. Nov 04 18:56:50 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812 Nov 04 18:56:50 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:50 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e35df214-b239-4071-a75c-cdd465e17812" returned: 0 in 0.273s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-e35df214-b239-4071-a75c-cdd465e17812" released by "delete_volume" :: held 0.856s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Created reservations ['900e352e-a9ca-46ef-868f-103dc4f2cab3', '6a31c20d-bd77-4079-8105-245cbb4c40a6', '5886bec0-a855-4665-b358-a5ec76bb66ac', '023fc7f2-1fc3-4d7e-912d-9f8ecb4ac20c'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:50 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:56:50 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-824ed921-8048-4af2-86bd-afaf07c659a6-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-824ed921-8048-4af2-86bd-afaf07c659a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-dcd3f268-f0b8-48fe-9db6-d379dce3940e" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-dcd3f268-f0b8-48fe-9db6-d379dce3940e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-824ed921-8048-4af2-86bd-afaf07c659a6" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-824ed921-8048-4af2-86bd-afaf07c659a6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:50 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Deleting offline snapshot 824ed921-8048-4af2-86bd-afaf07c659a6 of volume dcd3f268-f0b8-48fe-9db6-d379dce3940e {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] snapshot_file for this snap is: volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.313s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:50 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Deleted volume successfully. Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba5e70b-1adb-492a-9369-944e876b71c3]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4b9cad6e-70b2-4954-95ac-92441885fd66 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-e35df214-b239-4071-a75c-cdd465e17812-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:50 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 Nov 04 18:56:50 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Flow 'volume_create_manager' (99ea9632-a063-46ed-b550-ce831f6823a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f631d8f9-d89a-4c04-8234-6e55e1d519e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f631d8f9-d89a-4c04-8234-6e55e1d519e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1495254810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9673253c-5aa2-4372-97da-62b836403c38,host='devstack@QuobyteHD#QuobyteHD',id=e81ae490-9e93-4790-a6a1-d4504e22f8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee52901a5732403cbe9f3146ac687022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:51Z,use_quota=True,user_id='a8908d0187024a508111da949b220d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(122469a5-1c32-44a3-aa3d-0280e18a4c51),volume_type_id=122469a5-1c32-44a3-aa3d-0280e18a4c51)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7162e8a2-6617-4657-b9f3-2551ff2093a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7162e8a2-6617-4657-b9f3-2551ff2093a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1008d15-6484-4dec-bd2d-4af4daac8101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1008d15-6484-4dec-bd2d-4af4daac8101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e81ae490-9e93-4790-a6a1-d4504e22f8d3', 'volume_name': 'volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a19f2b-efa9-427d-9413-85f09a3991ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a19f2b-efa9-427d-9413-85f09a3991ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1382f8b0-92a6-4ad3-9d93-9ed3fde8d147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:51 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Volume e81ae490-9e93-4790-a6a1-d4504e22f8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3', 'volume_size': 1} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9673253c-5aa2-4372-97da-62b836403c38,created_at=2026-11-04T17:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1495254810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9673253c-5aa2-4372-97da-62b836403c38,host='devstack@QuobyteHD#QuobyteHD',id=e81ae490-9e93-4790-a6a1-d4504e22f8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee52901a5732403cbe9f3146ac687022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:51Z,use_quota=True,user_id='a8908d0187024a508111da949b220d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(122469a5-1c32-44a3-aa3d-0280e18a4c51),volume_type_id=122469a5-1c32-44a3-aa3d-0280e18a4c51)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Creating volume e81ae490-9e93-4790-a6a1-d4504e22f8d3 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:51 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:51 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3 1073741824 Nov 04 18:56:51 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:51 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6" returned: 0 in 0.478s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb5a6c9-e80f-4a70-aa50-a6c37fe88755]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:51 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e Nov 04 18:56:51 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:51 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3 1073741824" returned: 0 in 0.520s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:51 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3 Nov 04 18:56:51 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:51 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e" returned: 0 in 0.596s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:51 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 Nov 04 18:56:51 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:52 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3" returned: 0 in 0.282s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1382f8b0-92a6-4ad3-9d93-9ed3fde8d147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d1b2cc-9882-47ea-8f25-6b06da1d6cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:52 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Volume volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3 (e81ae490-9e93-4790-a6a1-d4504e22f8d3): created successfully Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d1b2cc-9882-47ea-8f25-6b06da1d6cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Flow 'volume_create_manager' (99ea9632-a063-46ed-b550-ce831f6823a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:52 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-83c17f0b-648e-4c13-b47f-77b287058c4d tempest-GroupsTest-753114618 None] Created volume successfully. Nov 04 18:56:52 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6" returned: 0 in 0.393s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:52 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6 Nov 04 18:56:52 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:52 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0f8e63b0-682b-4835-9634-ef8a2282f24a tempest-GroupsTest-753114618 None] Update group completed successfully. Nov 04 18:56:52 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e.824ed921-8048-4af2-86bd-afaf07c659a6" returned: 0 in 0.268s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-824ed921-8048-4af2-86bd-afaf07c659a6" released by "_delete_snapshot" :: held 1.897s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-dcd3f268-f0b8-48fe-9db6-d379dce3940e" released by "delete_snapshot" :: held 1.927s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Created reservations ['018fe66c-bdab-44bc-9515-722108d47d58', '418c4ff3-e1d0-431b-adc7-f0b3858c809d', 'ad84a41d-1ac5-4aed-b15c-cbe56eab81fb', '2ba38869-2a5c-4860-b84f-6960ed74ad6e'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:52 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Delete snapshot completed successfully. Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5a8730b4-3808-404d-b847-1c8c632030e5 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-824ed921-8048-4af2-86bd-afaf07c659a6-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-dcd3f268-f0b8-48fe-9db6-d379dce3940e-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-dcd3f268-f0b8-48fe-9db6-d379dce3940e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-dcd3f268-f0b8-48fe-9db6-d379dce3940e" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-dcd3f268-f0b8-48fe-9db6-d379dce3940e" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa104bf-529c-4954-9d6e-72886f57b99a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:53 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e Nov 04 18:56:53 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Flow 'volume_create_manager' (8313fa40-801f-4886-91a8-8c50d91e0ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e63977-e2e5-4ae8-aac2-0fc3c616ac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e63977-e2e5-4ae8-aac2-0fc3c616ac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-219027986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a4d694-f8c7-478e-b05b-cd2a6144f463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9279b14e65854c9a8afa3bc3838474eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:53Z,use_quota=True,user_id='75dbd134fe4d4069b5a90a827eea045d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e39491b-0b8e-44f4-bd7e-37bca7aea26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e39491b-0b8e-44f4-bd7e-37bca7aea26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b061b9a-c7d3-4a41-ae15-764f311d0c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.image.glance [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Creating Keystone auth plugin from conf {{(pid=87364) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 18:56:53 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e" returned: 0 in 0.387s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:53 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e Nov 04 18:56:53 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b061b9a-c7d3-4a41-ae15-764f311d0c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30a4d694-f8c7-478e-b05b-cd2a6144f463', 'volume_name': 'volume-30a4d694-f8c7-478e-b05b-cd2a6144f463', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4185b8b0-443c-4b7b-b14f-86d193439477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4185b8b0-443c-4b7b-b14f-86d193439477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f6fef1-0132-4af6-86f4-3f0f96509c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:53 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Volume 30a4d694-f8c7-478e-b05b-cd2a6144f463: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30a4d694-f8c7-478e-b05b-cd2a6144f463', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Trying to clone 30a4d694-f8c7-478e-b05b-cd2a6144f463 from image 49906b66-c86b-4e49-9cb0-47d303080f8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]). {{(pid=87364) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 18:56:53 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dcd3f268-f0b8-48fe-9db6-d379dce3940e" returned: 0 in 0.291s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-dcd3f268-f0b8-48fe-9db6-d379dce3940e" released by "delete_volume" :: held 0.759s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Created reservations ['527aaa91-e411-4ba0-894c-a6762f8e7adb', '5037598c-2fca-4be6-bc57-c356cb7ac4f1', 'e6781e83-6037-40d0-9c41-2c627edd186a', '19739b34-ff25-46fb-bd64-92669e306aca'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:54 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:56:54 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-536c3a49-d374-451f-adbe-5e2bc0778b1b tempest-GroupsTest-753114618 None] Update group completed successfully. Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 18:56:54 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Image download 20.69 MB at 20.69 MB/s Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80c7132-62cc-4bbe-a2fe-28554299c860]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:54 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD Nov 04 18:56:54 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:54 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.345s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Deleted volume successfully. Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54a1365d-2616-41a3-9b31-1e65030c2ccd tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-dcd3f268-f0b8-48fe-9db6-d379dce3940e-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:54 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Temporary image 49906b66-c86b-4e49-9cb0-47d303080f8f is fetched for user 75dbd134fe4d4069b5a90a827eea045d. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e0dcda-0018-446a-8c0d-977f2f00b321]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Flow 'volume_create_manager' (878ca916-6bf7-47ac-a8aa-2ddae39f362d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ab58dd-5eee-435b-9205-8bc917540152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ab58dd-5eee-435b-9205-8bc917540152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1443265049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fff2743-d56b-4dad-8895-76673c3a2342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b670cef6064da3aaa0c4046dd8bda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:55Z,use_quota=True,user_id='a4149e4e53c34d348e0542374eb83b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac09138a-2fc1-4c0c-a682-4543b72a6229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac09138a-2fc1-4c0c-a682-4543b72a6229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b325e4b-3a5c-4e3a-8a7f-432de88eb498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b325e4b-3a5c-4e3a-8a7f-432de88eb498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fff2743-d56b-4dad-8895-76673c3a2342', 'volume_name': 'volume-8fff2743-d56b-4dad-8895-76673c3a2342', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e03854b-da9a-4825-b0fa-cf71f3e86854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:54 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD Nov 04 18:56:54 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e03854b-da9a-4825-b0fa-cf71f3e86854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a72dfb7-4aa3-4f00-aa29-8239a87107a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:54 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume 8fff2743-d56b-4dad-8895-76673c3a2342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fff2743-d56b-4dad-8895-76673c3a2342', 'volume_size': 1} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1443265049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fff2743-d56b-4dad-8895-76673c3a2342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b670cef6064da3aaa0c4046dd8bda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:55Z,use_quota=True,user_id='a4149e4e53c34d348e0542374eb83b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Creating volume 8fff2743-d56b-4dad-8895-76673c3a2342 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:54 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:56:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:54 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 1073741824 Nov 04 18:56:54 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:55 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:55 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 1073741824" returned: 0 in 0.564s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:55 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 Nov 04 18:56:55 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Acquiring lock "cinder-quobyte-71cded3b-44ee-444f-8377-d30f8c795d4a" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Lock "cinder-quobyte-71cded3b-44ee-444f-8377-d30f8c795d4a" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[522716b5-4306-446c-adda-b876337be79c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:55 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342" returned: 0 in 0.319s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.678s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-219027986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a4d694-f8c7-478e-b05b-cd2a6144f463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9279b14e65854c9a8afa3bc3838474eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:56:53Z,use_quota=True,user_id='75dbd134fe4d4069b5a90a827eea045d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Creating volume 30a4d694-f8c7-478e-b05b-cd2a6144f463 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:56:55 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:55 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 1073741824 Nov 04 18:56:55 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a72dfb7-4aa3-4f00-aa29-8239a87107a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fff2743-d56b-4dad-8895-76673c3a2342', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:55 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a Nov 04 18:56:55 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d394298-86e0-4aea-a540-9e4abfa7fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:56:55 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume volume-8fff2743-d56b-4dad-8895-76673c3a2342 (8fff2743-d56b-4dad-8895-76673c3a2342): created successfully Nov 04 18:56:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d394298-86e0-4aea-a540-9e4abfa7fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Flow 'volume_create_manager' (878ca916-6bf7-47ac-a8aa-2ddae39f362d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:56:56 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-858690c1-aa78-4db0-9819-c885307a2944 tempest-VolumesSnapshotTestJSON-1538794110 None] Created volume successfully. Nov 04 18:56:56 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a" returned: 0 in 0.413s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:56 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a Nov 04 18:56:56 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:56 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 1073741824" returned: 0 in 0.555s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:56 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 Nov 04 18:56:56 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:56 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-71cded3b-44ee-444f-8377-d30f8c795d4a" returned: 0 in 0.285s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Lock "cinder-quobyte-71cded3b-44ee-444f-8377-d30f8c795d4a" released by "delete_volume" :: held 0.756s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Acquiring lock "cinder-quobyte-e81ae490-9e93-4790-a6a1-d4504e22f8d3" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Lock "cinder-quobyte-e81ae490-9e93-4790-a6a1-d4504e22f8d3" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f605c7fd-6077-44c6-801a-d49dfc93cee2]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:56 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3 Nov 04 18:56:56 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:56 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463" returned: 0 in 0.323s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Attempting download of 49906b66-c86b-4e49-9cb0-47d303080f8f ((None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}])) to volume 30a4d694-f8c7-478e-b05b-cd2a6144f463. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[243c3135-eee3-4c85-bff3-8349cacbfbd0]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_w38ugwqo {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] Creating offline snapshot bdfb3550-ce62-4b7d-b399-2707de98ecda of volume 8fff2743-d56b-4dad-8895-76673c3a2342 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:56:57 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:57 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_w38ugwqo Nov 04 18:56:57 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3" returned: 0 in 0.505s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96b3427-7c7e-46e2-acf9-d5baa1a063a2]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:57 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3 Nov 04 18:56:57 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:57 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 Nov 04 18:56:57 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:57 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_w38ugwqo" returned: 0 in 0.408s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_w38ugwqo {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:57 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e81ae490-9e93-4790-a6a1-d4504e22f8d3" returned: 0 in 0.282s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Lock "cinder-quobyte-e81ae490-9e93-4790-a6a1-d4504e22f8d3" released by "delete_volume" :: held 0.840s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:56:57 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_w38ugwqo Nov 04 18:56:57 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Created reservations ['7e6b224c-1006-4bcc-9de6-95102f127584'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:57 devstack cinder-volume[87364]: WARNING cinder.quota [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2141217553 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2141217553, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:56:57 devstack cinder-volume[87364]: WARNING cinder.quota [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2141217553 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2141217553, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Created reservations ['e5851886-319a-429c-b44c-63dc0207edb8', '2179b8c2-c7f0-4514-ad29-ce09de59f706', '3e3b2e27-d465-4dc3-8d7f-83dbe8f08b87', '056bc602-15d8-4a3f-8748-87b90954c1f1'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:57 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342" returned: 0 in 0.424s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:57 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda 1G Nov 04 18:56:57 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Created reservations ['109de0f7-ec41-438b-a390-512afec80312', '0f98cbf4-31f8-4b81-ac2c-5134755fb48c', '873f775d-3169-4862-9aa5-134c7cd7ac39', '8d193461-af8b-4be5-935f-b3435b132a6d'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:56:57 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_w38ugwqo" returned: 1 in 0.375s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_w38ugwqo' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[06770455-d32d-4927-855c-eee7fea10d9b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:57 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD Nov 04 18:56:57 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:57 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:56:57 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:57 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda 1G" returned: 0 in 0.465s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fff2743-d56b-4dad-8895-76673c3a2342 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:58 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fff2743-d56b-4dad-8895-76673c3a2342 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda Nov 04 18:56:58 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:58 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:58 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] 49906b66-c86b-4e49-9cb0-47d303080f8f was qcow2, converting to qcow2 {{(pid=87364) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 18:56:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:58 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.300s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:58 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:56:58 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 Nov 04 18:56:58 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:58 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-23f17277-a3f1-45dc-bf61-6652358a2629 tempest-GroupsTest-753114618 None] Delete group completed successfully. Nov 04 18:56:58 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fff2743-d56b-4dad-8895-76673c3a2342 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda" returned: 0 in 0.336s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:58 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda is being set with open permissions: ugo+rw Nov 04 18:56:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:58 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda Nov 04 18:56:58 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:58 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda" returned: 0 in 0.300s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:58 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.info Nov 04 18:56:58 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:59 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.info" returned: 0 in 0.309s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:59 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.info is being set with open permissions: ugo+rw Nov 04 18:56:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:56:59 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.info Nov 04 18:56:59 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:56:59 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Nov 04 18:56:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.info" returned: 0 in 0.303s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:56:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:56:59 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-88a1c3a6-fe3c-4dba-b29c-38c734d9a15c tempest-VolumesSnapshotTestJSON-1538794110 None] Create snapshot completed successfully Nov 04 18:57:00 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463" returned: 0 in 2.454s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:00 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_pvtmcz_jdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:57:00 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Converted 112.00 MB image at 45.61 MB/s Nov 04 18:57:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:00 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 1G Nov 04 18:57:00 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:01 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 1G" returned: 0 in 0.534s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Downloaded image 49906b66-c86b-4e49-9cb0-47d303080f8f ((None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}])) to volume 30a4d694-f8c7-478e-b05b-cd2a6144f463 successfully. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Temporary image 49906b66-c86b-4e49-9cb0-47d303080f8f for user 75dbd134fe4d4069b5a90a827eea045d is deleted. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Marking volume 30a4d694-f8c7-478e-b05b-cd2a6144f463 as bootable. {{(pid=87364) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Copying metadata from image 49906b66-c86b-4e49-9cb0-47d303080f8f to 30a4d694-f8c7-478e-b05b-cd2a6144f463. {{(pid=87364) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Creating volume glance metadata for volume 30a4d694-f8c7-478e-b05b-cd2a6144f463 backed by image 49906b66-c86b-4e49-9cb0-47d303080f8f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87364) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f6fef1-0132-4af6-86f4-3f0f96509c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a4d694-f8c7-478e-b05b-cd2a6144f463', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9aa5806-e7ad-449b-bf91-42580ef1707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:01 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Volume volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 (30a4d694-f8c7-478e-b05b-cd2a6144f463): created successfully Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9aa5806-e7ad-449b-bf91-42580ef1707e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Flow 'volume_create_manager' (8313fa40-801f-4886-91a8-8c50d91e0ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e5678a54-45df-460c-b8fa-c4de6ffc8e4e tempest-ServerActionsTestOtherA-510348025 None] Created volume successfully. Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Flow 'volume_create_manager' (900d6216-bf54-4c49-8475-276e0daa22f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ca1d10-7be1-4967-aabb-3ae1f472e0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ca1d10-7be1-4967-aabb-3ae1f472e0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1441509837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f790852-1176-470c-ad71-85e58bd32352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3bd7137b5d4940aa9d3656b3f8af08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:01Z,use_quota=True,user_id='45bcb58dfef744499f0089459a8b471c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1000c7e1-3d4a-4b88-ac25-0b21e53c259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1000c7e1-3d4a-4b88-ac25-0b21e53c259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e90991-aca5-4a91-9c65-b488f43559c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e90991-aca5-4a91-9c65-b488f43559c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f790852-1176-470c-ad71-85e58bd32352', 'volume_name': 'volume-4f790852-1176-470c-ad71-85e58bd32352', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81699cef-9cb4-4d7c-b1d7-ee574fa53bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81699cef-9cb4-4d7c-b1d7-ee574fa53bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f28e6c4-0048-4a36-8d31-fa44762998bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:01 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Volume 4f790852-1176-470c-ad71-85e58bd32352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f790852-1176-470c-ad71-85e58bd32352', 'volume_size': 1} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1441509837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f790852-1176-470c-ad71-85e58bd32352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3bd7137b5d4940aa9d3656b3f8af08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:01Z,use_quota=True,user_id='45bcb58dfef744499f0089459a8b471c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Creating volume 4f790852-1176-470c-ad71-85e58bd32352 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:01 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:01 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352 1073741824 Nov 04 18:57:01 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Flow 'volume_create_manager' (7e7dc40d-d4b6-40dd-9c4f-c2a8f8605fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a10ba15-1c81-4153-a3ee-93703ee8b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a10ba15-1c81-4153-a3ee-93703ee8b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1106505112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b584125-056a-44da-95cd-67e5c637c032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b670cef6064da3aaa0c4046dd8bda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bdfb3550-ce62-4b7d-b399-2707de98ecda,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:01Z,use_quota=True,user_id='a4149e4e53c34d348e0542374eb83b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be6dc3c-9ffe-460d-9f82-e097d3f54bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be6dc3c-9ffe-460d-9f82-e097d3f54bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06b3f85-9ea0-4871-b1f6-8f12617f5fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06b3f85-9ea0-4871-b1f6-8f12617f5fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b584125-056a-44da-95cd-67e5c637c032', 'volume_name': 'volume-7b584125-056a-44da-95cd-67e5c637c032', 'volume_size': 1, 'snapshot_id': 'bdfb3550-ce62-4b7d-b399-2707de98ecda'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86218a28-21cc-4413-adfd-08b7cb6f9714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86218a28-21cc-4413-adfd-08b7cb6f9714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf700ac-a44b-4d5b-ae81-1a661a41edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:01 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume 7b584125-056a-44da-95cd-67e5c637c032: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b584125-056a-44da-95cd-67e5c637c032', 'volume_size': 1, 'snapshot_id': 'bdfb3550-ce62-4b7d-b399-2707de98ecda'} Nov 04 18:57:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:02 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352 1073741824" returned: 0 in 0.601s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:02 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352 Nov 04 18:57:02 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:02 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352" returned: 0 in 0.316s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.832s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-bdfb3550-ce62-4b7d-b399-2707de98ecda-7b584125-056a-44da-95cd-67e5c637c032" by "_create_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f28e6c4-0048-4a36-8d31-fa44762998bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f790852-1176-470c-ad71-85e58bd32352', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c2cdcd-93e1-4003-ac01-0c0ec8fdeeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-bdfb3550-ce62-4b7d-b399-2707de98ecda-7b584125-056a-44da-95cd-67e5c637c032" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Creating volume 7b584125-056a-44da-95cd-67e5c637c032 from snapshot bdfb3550-ce62-4b7d-b399-2707de98ecda {{(pid=87364) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-7b584125-056a-44da-95cd-67e5c637c032" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:02 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Volume volume-4f790852-1176-470c-ad71-85e58bd32352 (4f790852-1176-470c-ad71-85e58bd32352): created successfully Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c2cdcd-93e1-4003-ac01-0c0ec8fdeeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Flow 'volume_create_manager' (900d6216-bf54-4c49-8475-276e0daa22f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-7b584125-056a-44da-95cd-67e5c637c032" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] snapshot: bdfb3550-ce62-4b7d-b399-2707de98ecda, volume: 7b584125-056a-44da-95cd-67e5c637c032, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 18:57:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7b8a539b-0f13-4bbd-86fb-3f46adc7e148 tempest-AttachVolumeNegativeTest-946051108 None] Created volume successfully. Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6057e6e1-7feb-4841-86a9-d1f8c17e1da6]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:02 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda Nov 04 18:57:02 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:03 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda" returned: 0 in 0.505s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fff2743-d56b-4dad-8895-76673c3a2342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:57:03 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f34632b-dd0f-4b89-9f6c-e3293057fc29]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:03 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 Nov 04 18:57:03 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:03 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342" returned: 0 in 0.605s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 18:57:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 18:57:03 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032 not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 18:57:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:03 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032 Nov 04 18:57:03 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-21452f12-0de5-41a3-90fa-7cd3256c5346 req-41ecf997-403d-474c-be5b-e551630c3037 tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-ccbfc414-2b42-448d-87dd-f777a8c3196f req-3de83e0d-b845-4a6d-a98c-9cd1cf69c87c tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:11 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032" returned: 0 in 8.111s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:11 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342, size 1024.00 MB, duration 8.11 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:57:11 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Converted 1024.00 MB image at 126.24 MB/s Nov 04 18:57:11 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032 is being set with open permissions: ugo+rw Nov 04 18:57:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:11 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032 Nov 04 18:57:11 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:12 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032" returned: 0 in 0.264s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-7b584125-056a-44da-95cd-67e5c637c032" released by "_copy_volume_from_snapshot" :: held 9.625s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-bdfb3550-ce62-4b7d-b399-2707de98ecda-7b584125-056a-44da-95cd-67e5c637c032" released by "_create_volume_from_snapshot" :: held 9.715s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.758s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-21452f12-0de5-41a3-90fa-7cd3256c5346 req-41ecf997-403d-474c-be5b-e551630c3037 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.956s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-21452f12-0de5-41a3-90fa-7cd3256c5346 req-41ecf997-403d-474c-be5b-e551630c3037 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-ccbfc414-2b42-448d-87dd-f777a8c3196f req-3de83e0d-b845-4a6d-a98c-9cd1cf69c87c tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.781s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf700ac-a44b-4d5b-ae81-1a661a41edd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b584125-056a-44da-95cd-67e5c637c032', 'volume_size': 1, 'snapshot_id': 'bdfb3550-ce62-4b7d-b399-2707de98ecda'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049591d2-663d-4a06-823c-7a822eeb1c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-ccbfc414-2b42-448d-87dd-f777a8c3196f req-3de83e0d-b845-4a6d-a98c-9cd1cf69c87c tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:12 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Volume volume-7b584125-056a-44da-95cd-67e5c637c032 (7b584125-056a-44da-95cd-67e5c637c032): created successfully Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049591d2-663d-4a06-823c-7a822eeb1c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Flow 'volume_create_manager' (7e7dc40d-d4b6-40dd-9c4f-c2a8f8605fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:12 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1cf41ed6-feef-4b8a-b772-c8c73d6f2b20 tempest-VolumesSnapshotTestJSON-1538794110 None] Created volume successfully. Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-21452f12-0de5-41a3-90fa-7cd3256c5346 req-41ecf997-403d-474c-be5b-e551630c3037 tempest-AttachVolumeNegativeTest-946051108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-4f790852-1176-470c-ad71-85e58bd32352', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73ddc364-6905-4f1a-9b9a-87e760cbff8e', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-ccbfc414-2b42-448d-87dd-f777a8c3196f req-3de83e0d-b845-4a6d-a98c-9cd1cf69c87c tempest-ServerActionsTestOtherA-510348025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-30a4d694-f8c7-478e-b05b-cd2a6144f463', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3075ab7-e620-452c-a653-e93903fbee3f', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:57:12 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-21452f12-0de5-41a3-90fa-7cd3256c5346 req-41ecf997-403d-474c-be5b-e551630c3037 tempest-AttachVolumeNegativeTest-946051108 None] attachment_update completed successfully. Nov 04 18:57:12 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-ccbfc414-2b42-448d-87dd-f777a8c3196f req-3de83e0d-b845-4a6d-a98c-9cd1cf69c87c tempest-ServerActionsTestOtherA-510348025 None] attachment_update completed successfully. Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-7b584125-056a-44da-95cd-67e5c637c032-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-7b584125-056a-44da-95cd-67e5c637c032-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-7b584125-056a-44da-95cd-67e5c637c032" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-7b584125-056a-44da-95cd-67e5c637c032" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:13 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dcfd3f-46e2-4fa7-b5ea-661acd4bc495]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:13 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032 Nov 04 18:57:13 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:14 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032" returned: 0 in 1.018s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:14 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032 Nov 04 18:57:14 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:14 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7b584125-056a-44da-95cd-67e5c637c032" returned: 0 in 0.372s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-7b584125-056a-44da-95cd-67e5c637c032" released by "delete_volume" :: held 1.474s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:14 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Created reservations ['ad76747c-d121-4313-9d4d-d52a42e98ead', 'd083e22f-1a6b-427c-9ce2-86998a97bb8c', '478b6dd8-ce88-4602-af5e-9007c13bee42', 'f1c122d7-c7d8-4d5c-8781-9e11fbcc9055'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:14 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:57:14 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:15 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.461s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:15 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Deleted volume successfully. Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f32ec412-7cb0-4768-821c-9f29cb4c86d8 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-7b584125-056a-44da-95cd-67e5c637c032-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-bdfb3550-ce62-4b7d-b399-2707de98ecda-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-bdfb3550-ce62-4b7d-b399-2707de98ecda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-8fff2743-d56b-4dad-8895-76673c3a2342" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-8fff2743-d56b-4dad-8895-76673c3a2342" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-bdfb3550-ce62-4b7d-b399-2707de98ecda" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-bdfb3550-ce62-4b7d-b399-2707de98ecda" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Deleting offline snapshot bdfb3550-ce62-4b7d-b399-2707de98ecda of volume 8fff2743-d56b-4dad-8895-76673c3a2342 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] snapshot_file for this snap is: volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da8274f-5f1a-435a-b177-4e2f8d74fd88]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:15 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda Nov 04 18:57:15 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:16 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:57:16 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:16 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda" returned: 0 in 1.144s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fff2743-d56b-4dad-8895-76673c3a2342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c9a7e1-7f78-4751-946a-9644147c1f88]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:16 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.823s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:17 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:57:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:57:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:57:17 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 Nov 04 18:57:17 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:17 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342" returned: 0 in 0.917s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:17 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda Nov 04 18:57:17 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:18 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda" returned: 0 in 0.732s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:18 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda Nov 04 18:57:18 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:18 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342.bdfb3550-ce62-4b7d-b399-2707de98ecda" returned: 0 in 0.494s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-bdfb3550-ce62-4b7d-b399-2707de98ecda" released by "_delete_snapshot" :: held 3.550s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-8fff2743-d56b-4dad-8895-76673c3a2342" released by "delete_snapshot" :: held 3.597s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:19 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Created reservations ['0503f3d8-ed13-465d-8638-64de4d9d981b', 'c0938b11-592b-4c45-9b9f-15c0e877c133', 'c330927c-087a-4fa5-8487-998e22a50f78', '5afe27cd-dde1-4c53-aeb0-cd2e00b9f86a'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:19 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Delete snapshot completed successfully. Nov 04 18:57:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-45b6cb59-f0a4-4cf6-80b9-96f654653462 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-bdfb3550-ce62-4b7d-b399-2707de98ecda-delete_snapshot" released by "delete_snapshot" :: held 3.848s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-8fff2743-d56b-4dad-8895-76673c3a2342-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-8fff2743-d56b-4dad-8895-76673c3a2342-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-8fff2743-d56b-4dad-8895-76673c3a2342" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-8fff2743-d56b-4dad-8895-76673c3a2342" acquired by "delete_volume" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:20 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f693a136-02d2-45f6-91bd-ca089f9e96ff]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:20 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 Nov 04 18:57:20 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:20 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342" returned: 0 in 0.513s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:20 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342 Nov 04 18:57:20 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:21 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8fff2743-d56b-4dad-8895-76673c3a2342" returned: 0 in 0.581s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-8fff2743-d56b-4dad-8895-76673c3a2342" released by "delete_volume" :: held 1.248s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:21 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Created reservations ['08b5c3a0-ef6b-499a-b9ec-efcbdd987d02', '45f65200-2c7e-466d-8b60-b73d8f4bd420', '92e8fd0c-f011-4e04-814e-84ccc66c0989', '1bd0333a-6e63-42a1-b191-6733d54d773e'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:21 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:57:21 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:21 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.365s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:22 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:22 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Deleted volume successfully. Nov 04 18:57:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f0f66ce6-0ff7-4bf5-8e79-ae24cabe86c2 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-8fff2743-d56b-4dad-8895-76673c3a2342-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-dd48b94d-052c-487e-9b14-64e0141de182-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-dd48b94d-052c-487e-9b14-64e0141de182-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "cinder-quobyte-dd48b94d-052c-487e-9b14-64e0141de182" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-dd48b94d-052c-487e-9b14-64e0141de182" acquired by "delete_volume" :: waited 0.046s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:23 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5babb72f-d607-4048-baf2-ac7c750d0710]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:23 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 Nov 04 18:57:23 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:24 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182" returned: 0 in 1.036s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:24 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182 Nov 04 18:57:24 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:24 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dd48b94d-052c-487e-9b14-64e0141de182" returned: 0 in 0.504s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-quobyte-dd48b94d-052c-487e-9b14-64e0141de182" released by "delete_volume" :: held 1.711s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:24 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Created reservations ['dad9cced-5b0b-4171-8cd6-9b69ecd2241e', '0608d941-4759-49f7-99eb-6dd3401301fa', 'ae0b8614-2c7b-4989-b7e8-c68587b29b72', '4eb737ae-c49b-4f13-881e-de26f0a06c00'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:25 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:57:25 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:25 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.679s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:25 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:25 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Deleted volume successfully. Nov 04 18:57:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-67274c61-b5fe-4729-a53b-c24a079753c3 tempest-VolumesSnapshotTestJSON-1538794110 None] Lock "cinder-dd48b94d-052c-487e-9b14-64e0141de182-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=111,cinder:SELECT=115,cinder:INSERT=33,cinder:DELETE=5 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=116,cinder:UPDATE=123,cinder:INSERT=33,cinder:DELETE=10 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Flow 'volume_create_manager' (992adec2-7558-4c63-aacd-d8052fe65dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cdac63-3245-46e8-b4d8-30db73a3fa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cdac63-3245-46e8-b4d8-30db73a3fa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1757487164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b4d5c5-192d-42cd-8179-54818acd1280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ecfcd730051424aad234825f07ad75b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:32Z,use_quota=True,user_id='25f9adda3e234681b40765e336819194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec45d37-024d-419c-9de8-4abf422a87d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec45d37-024d-419c-9de8-4abf422a87d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f0faaa-9b79-447a-8e9f-23113268c845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f0faaa-9b79-447a-8e9f-23113268c845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63b4d5c5-192d-42cd-8179-54818acd1280', 'volume_name': 'volume-63b4d5c5-192d-42cd-8179-54818acd1280', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d370d99c-1fc9-4fa2-8f0d-611f9abda70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d370d99c-1fc9-4fa2-8f0d-611f9abda70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa5c92f-1212-483f-b473-311a6f290631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:32 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Volume 63b4d5c5-192d-42cd-8179-54818acd1280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63b4d5c5-192d-42cd-8179-54818acd1280', 'volume_size': 1} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1757487164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b4d5c5-192d-42cd-8179-54818acd1280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ecfcd730051424aad234825f07ad75b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:32Z,use_quota=True,user_id='25f9adda3e234681b40765e336819194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Creating volume 63b4d5c5-192d-42cd-8179-54818acd1280 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:32 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:57:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:32 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280 1073741824 Nov 04 18:57:32 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-2717616a-289d-4692-9fc3-c8ec76264a6e req-7d4f098f-6849-412c-aa1e-09a73e86d6c9 tempest-ServerActionsTestOtherA-510348025 None] Terminate volume connection completed successfully. Nov 04 18:57:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-2717616a-289d-4692-9fc3-c8ec76264a6e req-7d4f098f-6849-412c-aa1e-09a73e86d6c9 tempest-ServerActionsTestOtherA-510348025 None] Deleting attachment e3075ab7-e620-452c-a653-e93903fbee3f. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:57:33 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280 1073741824" returned: 0 in 0.903s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:33 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280 Nov 04 18:57:33 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:34 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280" returned: 0 in 0.444s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa5c92f-1212-483f-b473-311a6f290631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63b4d5c5-192d-42cd-8179-54818acd1280', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9e1424-a34b-48d1-94c9-ea5bc0cc528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:34 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Volume volume-63b4d5c5-192d-42cd-8179-54818acd1280 (63b4d5c5-192d-42cd-8179-54818acd1280): created successfully Nov 04 18:57:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9e1424-a34b-48d1-94c9-ea5bc0cc528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Flow 'volume_create_manager' (992adec2-7558-4c63-aacd-d8052fe65dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:34 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ed098435-cabc-4acd-b29c-a53918e1a948 tempest-VolumeQuotasAdminTestJSON-669034514 None] Created volume successfully. Nov 04 18:57:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Acquiring lock "cinder-63b4d5c5-192d-42cd-8179-54818acd1280-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "cinder-63b4d5c5-192d-42cd-8179-54818acd1280-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Acquiring lock "cinder-quobyte-63b4d5c5-192d-42cd-8179-54818acd1280" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "cinder-quobyte-63b4d5c5-192d-42cd-8179-54818acd1280" acquired by "delete_volume" :: waited 0.048s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:35 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e221db49-c83f-47af-bef3-ef8d8fbeb50c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:36 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280 Nov 04 18:57:36 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:36 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280" returned: 0 in 0.615s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:36 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280 Nov 04 18:57:36 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:37 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-63b4d5c5-192d-42cd-8179-54818acd1280" returned: 0 in 0.532s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "cinder-quobyte-63b4d5c5-192d-42cd-8179-54818acd1280" released by "delete_volume" :: held 1.282s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Created reservations ['6fcd4fa2-52f4-413f-ba37-4d79418ca132', '801abd4d-243e-47ef-b07f-b403ea4dfd46', '28afd540-d69c-4992-8c4e-ab3290242db8', 'baa60b97-8f5e-4ad3-9a59-7832cf561e51'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-2717616a-289d-4692-9fc3-c8ec76264a6e req-91eee3df-02bf-42b8-ae94-c99f2b56a41b tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-2717616a-289d-4692-9fc3-c8ec76264a6e req-91eee3df-02bf-42b8-ae94-c99f2b56a41b tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-2717616a-289d-4692-9fc3-c8ec76264a6e req-91eee3df-02bf-42b8-ae94-c99f2b56a41b tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-2717616a-289d-4692-9fc3-c8ec76264a6e req-91eee3df-02bf-42b8-ae94-c99f2b56a41b tempest-ServerActionsTestOtherA-510348025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-30a4d694-f8c7-478e-b05b-cd2a6144f463', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6c62558-b508-4c5a-b694-91589de0c2c2', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:57:37 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:57:37 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-2717616a-289d-4692-9fc3-c8ec76264a6e req-91eee3df-02bf-42b8-ae94-c99f2b56a41b tempest-ServerActionsTestOtherA-510348025 None] attachment_update completed successfully. Nov 04 18:57:37 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.495s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Deleted volume successfully. Nov 04 18:57:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1c84d2b4-9450-4816-9d21-7a246ac3f3ac tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "cinder-63b4d5c5-192d-42cd-8179-54818acd1280-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Flow 'volume_create_manager' (1ca776b8-79bc-46da-8d42-5732c96ede92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1455f0-b3d0-42eb-bd7e-1ab7acb7a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1455f0-b3d0-42eb-bd7e-1ab7acb7a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-251367862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb732890-f901-427f-85e2-9fe6bfde12d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ecfcd730051424aad234825f07ad75b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:40Z,use_quota=True,user_id='25f9adda3e234681b40765e336819194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd99d30-d86d-44aa-abf5-2a889e8f5b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd99d30-d86d-44aa-abf5-2a889e8f5b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038c747b-bd04-467b-8531-32ec8a2d1c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038c747b-bd04-467b-8531-32ec8a2d1c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb732890-f901-427f-85e2-9fe6bfde12d3', 'volume_name': 'volume-eb732890-f901-427f-85e2-9fe6bfde12d3', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdb50ec-de1e-4ba3-b007-bb839fc65b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdb50ec-de1e-4ba3-b007-bb839fc65b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7897e1fa-9552-47ff-96af-ed52361b90e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:39 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Volume eb732890-f901-427f-85e2-9fe6bfde12d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb732890-f901-427f-85e2-9fe6bfde12d3', 'volume_size': 1} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-251367862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb732890-f901-427f-85e2-9fe6bfde12d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ecfcd730051424aad234825f07ad75b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:40Z,use_quota=True,user_id='25f9adda3e234681b40765e336819194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Creating volume eb732890-f901-427f-85e2-9fe6bfde12d3 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:39 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:57:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:39 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3 1073741824 Nov 04 18:57:39 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:40 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3 1073741824" returned: 0 in 1.094s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:41 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3 Nov 04 18:57:41 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:41 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3" returned: 0 in 0.878s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7897e1fa-9552-47ff-96af-ed52361b90e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb732890-f901-427f-85e2-9fe6bfde12d3', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7149e5e-4253-4fb2-9ef7-ba15799547f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:42 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Volume volume-eb732890-f901-427f-85e2-9fe6bfde12d3 (eb732890-f901-427f-85e2-9fe6bfde12d3): created successfully Nov 04 18:57:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7149e5e-4253-4fb2-9ef7-ba15799547f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Flow 'volume_create_manager' (1ca776b8-79bc-46da-8d42-5732c96ede92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4e09b6e1-281c-4691-b422-debb3361c098 tempest-VolumeQuotasAdminTestJSON-669034514 None] Created volume successfully. Nov 04 18:57:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4c2a8d67-c36e-49ab-a3f5-5c413a921d8c tempest-VolumeQuotasAdminTestJSON-67601303 None] Transfer volume completed successfully. Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Flow 'volume_create_manager' (8058f630-18b7-4d93-a1bc-2f16f50a1e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1791097-fe65-47d1-a1d4-2fd1d90a0b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1791097-fe65-47d1-a1d4-2fd1d90a0b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2058854783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf973ae-9bbc-4124-a9fe-78a800032727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b38fac05374b92b5cb673a26ec4d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:46Z,use_quota=True,user_id='e39bad83e9fc4cb8974354a1cff279ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a84998-d7ae-4e0f-b0d6-2d7fd9d8df17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a84998-d7ae-4e0f-b0d6-2d7fd9d8df17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da179551-d0d5-47ff-8e3d-dcae27807f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da179551-d0d5-47ff-8e3d-dcae27807f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf973ae-9bbc-4124-a9fe-78a800032727', 'volume_name': 'volume-dbf973ae-9bbc-4124-a9fe-78a800032727', 'volume_size': 2}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e968c88-0f53-4f34-9265-fee15e459dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e968c88-0f53-4f34-9265-fee15e459dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb8c5be-88dd-4353-8b6b-d88d167cc057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:46 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Volume dbf973ae-9bbc-4124-a9fe-78a800032727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf973ae-9bbc-4124-a9fe-78a800032727', 'volume_size': 2} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2058854783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf973ae-9bbc-4124-a9fe-78a800032727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b38fac05374b92b5cb673a26ec4d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:57:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:57:46Z,use_quota=True,user_id='e39bad83e9fc4cb8974354a1cff279ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Creating volume dbf973ae-9bbc-4124-a9fe-78a800032727 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:57:46 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 2147483648 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:46 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 2147483648 Nov 04 18:57:46 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:46 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Acquiring lock "cinder-eb732890-f901-427f-85e2-9fe6bfde12d3-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Lock "cinder-eb732890-f901-427f-85e2-9fe6bfde12d3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Acquiring lock "cinder-quobyte-eb732890-f901-427f-85e2-9fe6bfde12d3" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Lock "cinder-quobyte-eb732890-f901-427f-85e2-9fe6bfde12d3" acquired by "delete_volume" :: waited 0.035s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:47 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec5c2f8-1634-4875-bbfb-132a30238456]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:47 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3 Nov 04 18:57:47 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:47 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 2147483648" returned: 0 in 1.406s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:47 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 Nov 04 18:57:47 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:48 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3" returned: 0 in 1.093s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:48 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3 Nov 04 18:57:48 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:48 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727" returned: 0 in 0.725s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] <== create_volume: return (2257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.260s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb8c5be-88dd-4353-8b6b-d88d167cc057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf973ae-9bbc-4124-a9fe-78a800032727', 'volume_size': 2}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41d51c1-feee-46a2-b433-5b9c5384873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:57:48 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Volume volume-dbf973ae-9bbc-4124-a9fe-78a800032727 (dbf973ae-9bbc-4124-a9fe-78a800032727): created successfully Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41d51c1-feee-46a2-b433-5b9c5384873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Flow 'volume_create_manager' (8058f630-18b7-4d93-a1bc-2f16f50a1e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:57:48 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-94a29ae5-d90e-483f-aa21-efee3499483f tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Created volume successfully. Nov 04 18:57:48 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eb732890-f901-427f-85e2-9fe6bfde12d3" returned: 0 in 0.463s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Lock "cinder-quobyte-eb732890-f901-427f-85e2-9fe6bfde12d3" released by "delete_volume" :: held 1.639s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:48 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Created reservations ['79ec15ff-6ced-4ae0-bf11-0e9fb7a0b938', '6e7baa1c-bad3-484a-898e-23b81014332f', '654fe4e3-06c1-4a65-88b3-6078d3d3c00f', '9fe53295-aaa3-4c6b-8446-1226508ba49a'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:49 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:57:49 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Creating offline snapshot 2a7242b8-a71a-4860-8c18-cbed932d1d30 of volume dbf973ae-9bbc-4124-a9fe-78a800032727 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:57:49 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.561s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:49 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Deleted volume successfully. Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d314118-79c7-4038-a804-5eb90f24060c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58f6d8af-a8fe-4c4f-a511-a411bcab2bc2 tempest-VolumeQuotasAdminTestJSON-866197587 None] Lock "cinder-eb732890-f901-427f-85e2-9fe6bfde12d3-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:49 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 Nov 04 18:57:49 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:50 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727" returned: 0 in 0.612s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 2G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:50 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 2G Nov 04 18:57:50 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:50 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 2G" returned: 0 in 0.485s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf973ae-9bbc-4124-a9fe-78a800032727 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:50 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf973ae-9bbc-4124-a9fe-78a800032727 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 Nov 04 18:57:50 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:51 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf973ae-9bbc-4124-a9fe-78a800032727 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30" returned: 0 in 0.372s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:51 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 is being set with open permissions: ugo+rw Nov 04 18:57:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:51 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 Nov 04 18:57:51 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:51 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30" returned: 0 in 0.296s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:51 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.info Nov 04 18:57:51 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:51 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.info" returned: 0 in 0.342s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:51 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.info is being set with open permissions: ugo+rw Nov 04 18:57:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:51 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.info Nov 04 18:57:51 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:52 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.info" returned: 0 in 0.293s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:52 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4f9bd80f-687e-4d0e-aa2c-8426bcc42002 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Create snapshot completed successfully Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Acquiring lock "cinder-2a7242b8-a71a-4860-8c18-cbed932d1d30-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "cinder-2a7242b8-a71a-4860-8c18-cbed932d1d30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Acquiring lock "cinder-quobyte-dbf973ae-9bbc-4124-a9fe-78a800032727" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "cinder-quobyte-dbf973ae-9bbc-4124-a9fe-78a800032727" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Acquiring lock "cinder-quobyte-2a7242b8-a71a-4860-8c18-cbed932d1d30" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "cinder-quobyte-2a7242b8-a71a-4860-8c18-cbed932d1d30" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Deleting offline snapshot 2a7242b8-a71a-4860-8c18-cbed932d1d30 of volume dbf973ae-9bbc-4124-a9fe-78a800032727 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] snapshot_file for this snap is: volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb667b9-ced3-4cbc-a15b-c2e61f2db62d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:53 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 Nov 04 18:57:53 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:53 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30" returned: 0 in 0.500s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf973ae-9bbc-4124-a9fe-78a800032727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:57:53 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a062c2fe-b7b9-4ffa-abf4-07c4fea76673]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:53 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 Nov 04 18:57:53 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:53 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727" returned: 0 in 0.484s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:54 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 Nov 04 18:57:54 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:54 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30" returned: 0 in 0.468s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:54 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30 Nov 04 18:57:54 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:54 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727.2a7242b8-a71a-4860-8c18-cbed932d1d30" returned: 0 in 0.462s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "cinder-quobyte-2a7242b8-a71a-4860-8c18-cbed932d1d30" released by "_delete_snapshot" :: held 2.092s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "cinder-quobyte-dbf973ae-9bbc-4124-a9fe-78a800032727" released by "delete_snapshot" :: held 2.139s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:55 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Created reservations ['b277965b-d472-4b9b-8f20-e1027b97cd39', 'efc38e61-ea8f-4b19-b4dd-540c8a1abddc', '94b70698-1bdb-4946-a271-9764fb8f339b', 'b559f945-2187-41d5-bcb5-fa8d66770064'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:55 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Delete snapshot completed successfully. Nov 04 18:57:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-18c22779-3ce1-46cb-8b48-903bac99f284 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "cinder-2a7242b8-a71a-4860-8c18-cbed932d1d30-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Acquiring lock "cinder-dbf973ae-9bbc-4124-a9fe-78a800032727-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "cinder-dbf973ae-9bbc-4124-a9fe-78a800032727-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Acquiring lock "cinder-quobyte-dbf973ae-9bbc-4124-a9fe-78a800032727" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:57:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "cinder-quobyte-dbf973ae-9bbc-4124-a9fe-78a800032727" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:57:56 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef4bb91-1e54-4bf4-983e-300a4ad3f7b2]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:57:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:56 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 Nov 04 18:57:56 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:56 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727" returned: 0 in 0.511s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:57 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727 Nov 04 18:57:57 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:57 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dbf973ae-9bbc-4124-a9fe-78a800032727" returned: 0 in 0.369s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "cinder-quobyte-dbf973ae-9bbc-4124-a9fe-78a800032727" released by "delete_volume" :: held 0.965s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Created reservations ['838e0a34-b889-49ca-b76b-2e6f8102cd19', 'd3a3c51c-e8f7-4c23-9b04-1a6c4b87f4bb', 'faa09da6-92a4-4b9e-b8de-a29bc76c6c23', '864b0505-e441-4bc1-966e-cd7c9f4a03e3'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:57:57 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:57:57 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:57:57 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.329s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:57:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Deleted volume successfully. Nov 04 18:57:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ad65c7ab-85d7-403b-94a4-f16818722f67 tempest-VolumesSnapshotNegativeTestJSON-474605580 None] Lock "cinder-dbf973ae-9bbc-4124-a9fe-78a800032727-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Flow 'volume_create_manager' (fb4b621f-2a11-49d2-96cc-c83deb7da607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1b7c9a-41d7-45c6-b502-47a9665b9a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1b7c9a-41d7-45c6-b502-47a9665b9a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-447922748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be39d897-a6dd-41d2-a49d-90a8ed628677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a46c97ca7ba43288a4acb9d13f20be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:01Z,use_quota=True,user_id='a5838303c1594962bc0153b7822f5f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7219d97d-d982-4455-9455-203687147623),volume_type_id=7219d97d-d982-4455-9455-203687147623)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fb270f-2977-4cdd-9459-d846e535173e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fb270f-2977-4cdd-9459-d846e535173e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df3282b-ca1e-4f3d-962f-aa3f566b2bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df3282b-ca1e-4f3d-962f-aa3f566b2bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be39d897-a6dd-41d2-a49d-90a8ed628677', 'volume_name': 'volume-be39d897-a6dd-41d2-a49d-90a8ed628677', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7322fcd-8a1f-4419-be28-dd443b3558ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7322fcd-8a1f-4419-be28-dd443b3558ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f233232f-0ad1-4d93-802a-f591a1edee93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:01 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Volume be39d897-a6dd-41d2-a49d-90a8ed628677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be39d897-a6dd-41d2-a49d-90a8ed628677', 'volume_size': 1} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-447922748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be39d897-a6dd-41d2-a49d-90a8ed628677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a46c97ca7ba43288a4acb9d13f20be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:01Z,use_quota=True,user_id='a5838303c1594962bc0153b7822f5f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7219d97d-d982-4455-9455-203687147623),volume_type_id=7219d97d-d982-4455-9455-203687147623)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Creating volume be39d897-a6dd-41d2-a49d-90a8ed628677 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:01 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:01 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677 1073741824 Nov 04 18:58:01 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:01 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677 1073741824" returned: 0 in 0.663s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:02 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677 Nov 04 18:58:02 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:02 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677" returned: 0 in 0.452s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f233232f-0ad1-4d93-802a-f591a1edee93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be39d897-a6dd-41d2-a49d-90a8ed628677', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee21eac7-596d-47e1-bb75-3610aa17a848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:02 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Volume volume-be39d897-a6dd-41d2-a49d-90a8ed628677 (be39d897-a6dd-41d2-a49d-90a8ed628677): created successfully Nov 04 18:58:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee21eac7-596d-47e1-bb75-3610aa17a848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Flow 'volume_create_manager' (fb4b621f-2a11-49d2-96cc-c83deb7da607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9b400580-f89c-4f0b-9c4d-23b3036427fa tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Created volume successfully. Nov 04 18:58:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0678a670-c94a-4bd0-a0b8-55eb5b3117a4 tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0678a670-c94a-4bd0-a0b8-55eb5b3117a4 tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0678a670-c94a-4bd0-a0b8-55eb5b3117a4 tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0678a670-c94a-4bd0-a0b8-55eb5b3117a4 tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0678a670-c94a-4bd0-a0b8-55eb5b3117a4 tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0678a670-c94a-4bd0-a0b8-55eb5b3117a4 tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:04 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:58:04 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:04 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0678a670-c94a-4bd0-a0b8-55eb5b3117a4 tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.304s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:04 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-0678a670-c94a-4bd0-a0b8-55eb5b3117a4 tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:04 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0678a670-c94a-4bd0-a0b8-55eb5b3117a4 tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Retype volume completed successfully. Nov 04 18:58:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Acquiring lock "cinder-be39d897-a6dd-41d2-a49d-90a8ed628677-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "cinder-be39d897-a6dd-41d2-a49d-90a8ed628677-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Acquiring lock "cinder-quobyte-be39d897-a6dd-41d2-a49d-90a8ed628677" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "cinder-quobyte-be39d897-a6dd-41d2-a49d-90a8ed628677" acquired by "delete_volume" :: waited 0.048s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:05 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3acd8c4-e0d5-4697-b3e7-4e7a42557ade]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:05 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677 Nov 04 18:58:05 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:06 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677" returned: 0 in 0.478s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:06 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677 Nov 04 18:58:06 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:06 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be39d897-a6dd-41d2-a49d-90a8ed628677" returned: 0 in 0.298s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "cinder-quobyte-be39d897-a6dd-41d2-a49d-90a8ed628677" released by "delete_volume" :: held 0.857s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:06 devstack cinder-volume[87364]: WARNING cinder.quota [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:58:06 devstack cinder-volume[87364]: WARNING cinder.quota [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:58:06 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Created reservations ['7d67b06f-975e-40bd-930f-9fcd046f145d', '84ef95a8-2beb-40ec-ae56-9aded216b1b8', 'e3fc593e-a4f8-48dd-a9cd-5e535f983d41', '0f257c13-79a1-4ab3-a349-eae4e87654b9'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:58:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:06 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:58:06 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:07 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.407s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:07 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:07 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Deleted volume successfully. Nov 04 18:58:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cbe347d0-4ee8-422b-a156-126d76ca1b2f tempest-VolumeRetypeWithoutMigrationTest-1388203018 None] Lock "cinder-be39d897-a6dd-41d2-a49d-90a8ed628677-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:08 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-e105bd0d-1376-4175-906b-800fdf8847b9 req-98f8525b-d372-4df9-b3e2-6cf20e08a5b9 tempest-AttachVolumeNegativeTest-946051108 None] Terminate volume connection completed successfully. Nov 04 18:58:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-e105bd0d-1376-4175-906b-800fdf8847b9 req-98f8525b-d372-4df9-b3e2-6cf20e08a5b9 tempest-AttachVolumeNegativeTest-946051108 None] Deleting attachment 73ddc364-6905-4f1a-9b9a-87e760cbff8e. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:16 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:58:16 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:16 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.304s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:58:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:58:18 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=53,cinder:UPDATE=58,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:58:18 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=53,cinder:UPDATE=56,cinder:INSERT=11,cinder:DELETE=7 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:58:30 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-5c3af59c-c12e-45f2-82db-151f8bead9fb tempest-ServerActionsTestOtherA-510348025 None] Terminate volume connection completed successfully. Nov 04 18:58:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-5c3af59c-c12e-45f2-82db-151f8bead9fb tempest-ServerActionsTestOtherA-510348025 None] Deleting attachment f6c62558-b508-4c5a-b694-91589de0c2c2. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:58:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "cinder-30a4d694-f8c7-478e-b05b-cd2a6144f463-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Lock "cinder-30a4d694-f8c7-478e-b05b-cd2a6144f463-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "cinder-quobyte-30a4d694-f8c7-478e-b05b-cd2a6144f463" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Lock "cinder-quobyte-30a4d694-f8c7-478e-b05b-cd2a6144f463" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:31 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0f2d27-3c40-498e-90bd-cc581b280246]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:31 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 Nov 04 18:58:31 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:31 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463" returned: 0 in 0.603s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:31 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463 Nov 04 18:58:31 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:32 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30a4d694-f8c7-478e-b05b-cd2a6144f463" returned: 0 in 0.398s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Lock "cinder-quobyte-30a4d694-f8c7-478e-b05b-cd2a6144f463" released by "delete_volume" :: held 1.074s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG cinder.quota [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Created reservations ['22fa0d0a-71bf-45c2-8ea4-e7e1596415d8', '50623b96-05e6-47c3-b6e3-5c3f28937853', '37b890c9-8dc3-4cb8-9906-589f88d68a0c', 'f4a52a22-7940-4d4c-83b4-e4cb488ab2a0'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:32 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:58:32 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:32 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.369s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG cinder.manager [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:32 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Deleted volume successfully. Nov 04 18:58:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-4416dbf2-bc78-4c2b-ae45-5c31e06358a9 req-2497b659-8f7f-4ea7-8ece-2ddb8e61875e tempest-ServerActionsTestOtherA-510348025 None] Lock "cinder-30a4d694-f8c7-478e-b05b-cd2a6144f463-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "cinder-bca4f364-44c7-420a-a6db-d09ed6170e32-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Lock "cinder-bca4f364-44c7-420a-a6db-d09ed6170e32-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "cinder-quobyte-bca4f364-44c7-420a-a6db-d09ed6170e32" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Lock "cinder-quobyte-bca4f364-44c7-420a-a6db-d09ed6170e32" acquired by "delete_volume" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:33 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[132c7eb5-015d-4e87-bebc-cfefc4f675f9]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:33 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32 Nov 04 18:58:33 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:33 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32" returned: 0 in 0.487s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:33 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32 Nov 04 18:58:33 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:34 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bca4f364-44c7-420a-a6db-d09ed6170e32" returned: 0 in 0.385s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Lock "cinder-quobyte-bca4f364-44c7-420a-a6db-d09ed6170e32" released by "delete_volume" :: held 0.955s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:34 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Created reservations ['773a31ac-8ce9-468d-b67d-4374cec2a40b', '545fb0e4-8e23-4cd6-bf91-56a6cb04caa8', '321bf855-a49b-4f9f-9bd4-216636bb2c05', 'df1fae18-c04e-4ee9-8752-095ea08bded7'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:58:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:34 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:58:34 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:34 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.544s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:35 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:35 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Deleted volume successfully. Nov 04 18:58:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fb2f2e03-4f87-413c-acaa-16a657e91227 tempest-ServerActionsTestOtherA-510348025 None] Lock "cinder-bca4f364-44c7-420a-a6db-d09ed6170e32-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Flow 'volume_create_manager' (50c9e0f4-7f88-486a-bd4b-e255090cc00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04e4ef0-544a-436d-9ce9-bdf3049cc9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04e4ef0-544a-436d-9ce9-bdf3049cc9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1856042761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e34e763-184e-4102-8ed8-898e52ee2551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15d1742797b94ccd8e32078bc399c7ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:37Z,use_quota=True,user_id='ff662c5576a14230a5b0da858cf30a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(316ec132-d778-4ce9-a20e-e15e30a5897d),volume_type_id=316ec132-d778-4ce9-a20e-e15e30a5897d)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998c24c2-756a-400d-abeb-c53c470abe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998c24c2-756a-400d-abeb-c53c470abe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a28ac9-a888-4cab-a192-77cf54bf74c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a28ac9-a888-4cab-a192-77cf54bf74c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e34e763-184e-4102-8ed8-898e52ee2551', 'volume_name': 'volume-6e34e763-184e-4102-8ed8-898e52ee2551', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1293c5b8-1aa1-4cd3-98e4-919f2958d253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1293c5b8-1aa1-4cd3-98e4-919f2958d253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b342a3-4349-43f0-aa8d-a25f447c32b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:37 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Volume 6e34e763-184e-4102-8ed8-898e52ee2551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e34e763-184e-4102-8ed8-898e52ee2551', 'volume_size': 1} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1856042761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e34e763-184e-4102-8ed8-898e52ee2551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15d1742797b94ccd8e32078bc399c7ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:37Z,use_quota=True,user_id='ff662c5576a14230a5b0da858cf30a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(316ec132-d778-4ce9-a20e-e15e30a5897d),volume_type_id=316ec132-d778-4ce9-a20e-e15e30a5897d)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Creating volume 6e34e763-184e-4102-8ed8-898e52ee2551 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:37 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:58:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:37 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551 1073741824 Nov 04 18:58:37 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Flow 'volume_create_manager' (868b16bd-cc82-4e21-8262-140a26008235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e6b1a2-3341-4a2d-9ce2-5ac478e372e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e6b1a2-3341-4a2d-9ce2-5ac478e372e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-972728278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab87981-7e07-4f35-b4e1-102c3d8dca5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15d1742797b94ccd8e32078bc399c7ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:38Z,use_quota=True,user_id='ff662c5576a14230a5b0da858cf30a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fab61b34-677e-456d-9a50-ebca1d7a2e18),volume_type_id=fab61b34-677e-456d-9a50-ebca1d7a2e18)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d266874-84e1-4409-9981-0698896452b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d266874-84e1-4409-9981-0698896452b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae6b2d7-f9e1-45d8-8344-3ea1e94eef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae6b2d7-f9e1-45d8-8344-3ea1e94eef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab87981-7e07-4f35-b4e1-102c3d8dca5a', 'volume_name': 'volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4794cd9-ac3b-4563-86ff-f04338b407a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4794cd9-ac3b-4563-86ff-f04338b407a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cced9c36-cd0b-4f82-b73b-c4aeb6a26460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:38 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Volume 5ab87981-7e07-4f35-b4e1-102c3d8dca5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a', 'volume_size': 1} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:38 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551 1073741824" returned: 0 in 1.185s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:38 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551 Nov 04 18:58:38 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:39 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551" returned: 0 in 0.725s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.194s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-972728278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab87981-7e07-4f35-b4e1-102c3d8dca5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15d1742797b94ccd8e32078bc399c7ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:38Z,use_quota=True,user_id='ff662c5576a14230a5b0da858cf30a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fab61b34-677e-456d-9a50-ebca1d7a2e18),volume_type_id=fab61b34-677e-456d-9a50-ebca1d7a2e18)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Creating volume 5ab87981-7e07-4f35-b4e1-102c3d8dca5a {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:39 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b342a3-4349-43f0-aa8d-a25f447c32b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e34e763-184e-4102-8ed8-898e52ee2551', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb4471d-3287-47d4-9f19-da3cf76dc23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:39 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a 1073741824 Nov 04 18:58:39 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Volume volume-6e34e763-184e-4102-8ed8-898e52ee2551 (6e34e763-184e-4102-8ed8-898e52ee2551): created successfully Nov 04 18:58:39 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb4471d-3287-47d4-9f19-da3cf76dc23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Flow 'volume_create_manager' (50c9e0f4-7f88-486a-bd4b-e255090cc00f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:39 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-eca32c01-35dd-4344-9689-025086f63bbd tempest-TestInstancesWithCinderVolumes-200175985 None] Created volume successfully. Nov 04 18:58:39 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Flow 'volume_create_manager' (a14c8e9b-ab58-45a9-9701-aa0c91943adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e60616-6ed0-4ae6-89cc-6e2dc0d3c4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e60616-6ed0-4ae6-89cc-6e2dc0d3c4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-796468110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e588e8b0-b53a-4908-b221-7ccc5ce8f4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15d1742797b94ccd8e32078bc399c7ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:40Z,use_quota=True,user_id='ff662c5576a14230a5b0da858cf30a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c212e8c-eb8c-4326-ab9d-57cff92dee25),volume_type_id=4c212e8c-eb8c-4326-ab9d-57cff92dee25)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b0438d-9dff-49f6-a0c0-e452a939e02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b0438d-9dff-49f6-a0c0-e452a939e02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7030cb-0327-4490-9eba-1db53e23938a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.image.glance [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Creating Keystone auth plugin from conf {{(pid=87364) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7030cb-0327-4490-9eba-1db53e23938a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e588e8b0-b53a-4908-b221-7ccc5ce8f4ba', 'volume_name': 'volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba', 'volume_size': 1, 'image_id': '2901a571-c406-4758-8d39-a12e27fb17fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2901a571-c406-4758-8d39-a12e27fb17fb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2011382572', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15d1742797b94ccd8e32078bc399c7ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2901a571-c406-4758-8d39-a12e27fb17fb', 'created_at': datetime.datetime(2026, 11, 4, 17, 58, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2901a571-c406-4758-8d39-a12e27fb17fb/file', 'properties': {}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8104bbde-dcb4-46d0-afbe-638f0d5c5504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8104bbde-dcb4-46d0-afbe-638f0d5c5504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:40 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25b8c73-86ff-4109-b2f9-70d835f4de98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:40 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Volume e588e8b0-b53a-4908-b221-7ccc5ce8f4ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba', 'volume_size': 1, 'image_id': '2901a571-c406-4758-8d39-a12e27fb17fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2901a571-c406-4758-8d39-a12e27fb17fb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2011382572', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15d1742797b94ccd8e32078bc399c7ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2901a571-c406-4758-8d39-a12e27fb17fb', 'created_at': datetime.datetime(2026, 11, 4, 17, 58, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2901a571-c406-4758-8d39-a12e27fb17fb/file', 'properties': {}}, 'image_service': } Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Trying to clone e588e8b0-b53a-4908-b221-7ccc5ce8f4ba from image 2901a571-c406-4758-8d39-a12e27fb17fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/2901a571-c406-4758-8d39-a12e27fb17fb', 'metadata': {}}]). {{(pid=87364) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a 1073741824" returned: 0 in 1.198s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:40 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a Nov 04 18:58:40 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:41 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a" returned: 0 in 0.595s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cced9c36-cd0b-4f82-b73b-c4aeb6a26460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2e10f9-9f35-461a-a1b6-ed084fd74786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:41 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Volume volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a (5ab87981-7e07-4f35-b4e1-102c3d8dca5a): created successfully Nov 04 18:58:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2e10f9-9f35-461a-a1b6-ed084fd74786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Flow 'volume_create_manager' (868b16bd-cc82-4e21-8262-140a26008235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-815360c8-91f6-4c02-8ce8-140ba4f3a9c1 tempest-TestInstancesWithCinderVolumes-200175985 None] Created volume successfully. Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Flow 'volume_create_manager' (a5781e7f-32a1-4435-a8c3-43703f4e653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb452e9-7325-4b88-ac07-bebb56b1a164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb452e9-7325-4b88-ac07-bebb56b1a164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-112791266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5eec57-ec17-4c83-aae4-1e956ef603ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2842db637a24715963c399b6649ee5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:46Z,use_quota=True,user_id='127cb204dff74c689f196a006f4e4744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535be341-4441-4cd5-b8aa-a25fc713718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535be341-4441-4cd5-b8aa-a25fc713718a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac19e3e-61ae-4746-9925-3600da52247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac19e3e-61ae-4746-9925-3600da52247c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5eec57-ec17-4c83-aae4-1e956ef603ed', 'volume_name': 'volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f81fa4d-9232-4667-9cde-1f63c71c01c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f81fa4d-9232-4667-9cde-1f63c71c01c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429107b4-5fb4-4ec3-8718-4201c5f0c192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:45 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Volume ae5eec57-ec17-4c83-aae4-1e956ef603ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed', 'volume_size': 1} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-112791266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5eec57-ec17-4c83-aae4-1e956ef603ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2842db637a24715963c399b6649ee5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:46Z,use_quota=True,user_id='127cb204dff74c689f196a006f4e4744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Creating volume ae5eec57-ec17-4c83-aae4-1e956ef603ed {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:45 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:58:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:45 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed 1073741824 Nov 04 18:58:45 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD, size 20.69 MB, duration 5.58 sec {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 18:58:46 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Image download 20.69 MB at 3.71 MB/s Nov 04 18:58:46 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed 1073741824" returned: 0 in 0.578s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca3ff36-476b-48c4-bb6b-49fde56b0a75]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:46 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed Nov 04 18:58:46 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:46 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD Nov 04 18:58:46 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:46 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed" returned: 0 in 0.364s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429107b4-5fb4-4ec3-8718-4201c5f0c192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e59912c-0af4-4f03-a527-06e6d22abf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:46 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Temporary image 2901a571-c406-4758-8d39-a12e27fb17fb is fetched for user ff662c5576a14230a5b0da858cf30a57. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 18:58:46 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Volume volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed (ae5eec57-ec17-4c83-aae4-1e956ef603ed): created successfully Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e59912c-0af4-4f03-a527-06e6d22abf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Flow 'volume_create_manager' (a5781e7f-32a1-4435-a8c3-43703f4e653e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:46 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c09bb957-aada-406c-9095-2c7d79970b81 tempest-AbsoluteLimitsTests-1901627142 None] Created volume successfully. Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cfb496-0f86-40c5-b4b3-a92beb3758a7]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:47 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD Nov 04 18:58:47 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:47 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-796468110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e588e8b0-b53a-4908-b221-7ccc5ce8f4ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15d1742797b94ccd8e32078bc399c7ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:40Z,use_quota=True,user_id='ff662c5576a14230a5b0da858cf30a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c212e8c-eb8c-4326-ab9d-57cff92dee25),volume_type_id=4c212e8c-eb8c-4326-ab9d-57cff92dee25)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Creating volume e588e8b0-b53a-4908-b221-7ccc5ce8f4ba {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:47 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:47 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba 1073741824 Nov 04 18:58:47 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Acquiring lock "cinder-ae5eec57-ec17-4c83-aae4-1e956ef603ed-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Lock "cinder-ae5eec57-ec17-4c83-aae4-1e956ef603ed-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:47 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba 1073741824" returned: 0 in 0.617s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Acquiring lock "cinder-quobyte-ae5eec57-ec17-4c83-aae4-1e956ef603ed" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:48 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba Nov 04 18:58:48 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Lock "cinder-quobyte-ae5eec57-ec17-4c83-aae4-1e956ef603ed" acquired by "delete_volume" :: waited 0.059s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a12793d-75be-48be-8dfa-302ba061ccba]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:48 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:48 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba" returned: 0 in 0.424s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:48 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Attempting download of 2901a571-c406-4758-8d39-a12e27fb17fb ((None, [{'url': 'file:///opt/stack/data/glance/images/2901a571-c406-4758-8d39-a12e27fb17fb', 'metadata': {}}])) to volume e588e8b0-b53a-4908-b221-7ccc5ce8f4ba. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78da6ab-b0d9-40d8-b205-9bca6b2094aa]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2901a571-c406-4758-8d39-a12e27fb17fb_35s4hnne {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:48 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2901a571-c406-4758-8d39-a12e27fb17fb_35s4hnne Nov 04 18:58:48 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:48 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed" returned: 0 in 0.701s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:48 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed Nov 04 18:58:48 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:49 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2901a571-c406-4758-8d39-a12e27fb17fb_35s4hnne" returned: 0 in 0.422s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2901a571-c406-4758-8d39-a12e27fb17fb_35s4hnne {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:49 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2901a571-c406-4758-8d39-a12e27fb17fb_35s4hnne Nov 04 18:58:49 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:49 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ae5eec57-ec17-4c83-aae4-1e956ef603ed" returned: 0 in 0.369s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Lock "cinder-quobyte-ae5eec57-ec17-4c83-aae4-1e956ef603ed" released by "delete_volume" :: held 1.192s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Created reservations ['70a17bbe-bb5b-48ce-b052-bb1f0be89450', '7c67a760-84e2-466f-af2a-14060a67c39a', 'a327867c-4253-4aa2-9d46-b2743ae50622', 'bb19efbb-3eb4-47b4-aa3b-edb41e509c51'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:49 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2901a571-c406-4758-8d39-a12e27fb17fb_35s4hnne" returned: 1 in 0.576s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2901a571-c406-4758-8d39-a12e27fb17fb_35s4hnne' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd19819-90b0-46d2-a45a-ed47ff00df74]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:58:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:49 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:58:49 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:49 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD Nov 04 18:58:49 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:50 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.617s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:50 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:58:50 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Deleted volume successfully. Nov 04 18:58:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa7a75ae-c42b-49ce-97d9-3bd4b5ec4e0b tempest-AbsoluteLimitsTests-1901627142 None] Lock "cinder-ae5eec57-ec17-4c83-aae4-1e956ef603ed-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:58:50 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:50 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] 2901a571-c406-4758-8d39-a12e27fb17fb was qcow2, converting to qcow2 {{(pid=87364) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 18:58:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:50 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba Nov 04 18:58:50 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:52 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba" returned: 0 in 2.379s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:52 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2901a571-c406-4758-8d39-a12e27fb17fb_tim1vbuzdevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:58:52 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Converted 112.00 MB image at 47.05 MB/s Nov 04 18:58:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:52 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba 1G Nov 04 18:58:52 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:53 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba 1G" returned: 0 in 0.459s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:53 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Downloaded image 2901a571-c406-4758-8d39-a12e27fb17fb ((None, [{'url': 'file:///opt/stack/data/glance/images/2901a571-c406-4758-8d39-a12e27fb17fb', 'metadata': {}}])) to volume e588e8b0-b53a-4908-b221-7ccc5ce8f4ba successfully. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 18:58:53 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Temporary image 2901a571-c406-4758-8d39-a12e27fb17fb for user ff662c5576a14230a5b0da858cf30a57 is deleted. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 18:58:53 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Marking volume e588e8b0-b53a-4908-b221-7ccc5ce8f4ba as bootable. {{(pid=87364) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 18:58:53 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Copying metadata from image 2901a571-c406-4758-8d39-a12e27fb17fb to e588e8b0-b53a-4908-b221-7ccc5ce8f4ba. {{(pid=87364) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 18:58:53 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Creating volume glance metadata for volume e588e8b0-b53a-4908-b221-7ccc5ce8f4ba backed by image 2901a571-c406-4758-8d39-a12e27fb17fb with: {'image_id': '2901a571-c406-4758-8d39-a12e27fb17fb', 'image_name': 'tempest-scenario-img--2011382572', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87364) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 18:58:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25b8c73-86ff-4109-b2f9-70d835f4de98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba', 'volume_size': 1, 'image_id': '2901a571-c406-4758-8d39-a12e27fb17fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2901a571-c406-4758-8d39-a12e27fb17fb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2011382572', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '15d1742797b94ccd8e32078bc399c7ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2901a571-c406-4758-8d39-a12e27fb17fb', 'created_at': datetime.datetime(2026, 11, 4, 17, 58, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2901a571-c406-4758-8d39-a12e27fb17fb/file', 'properties': {}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3979ad6b-0af9-4f84-8a95-a1960fe72234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:53 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Volume volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba (e588e8b0-b53a-4908-b221-7ccc5ce8f4ba): created successfully Nov 04 18:58:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3979ad6b-0af9-4f84-8a95-a1960fe72234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Flow 'volume_create_manager' (a14c8e9b-ab58-45a9-9701-aa0c91943adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:53 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c4d03c63-a8de-414a-9d50-6c6add9e8f4b tempest-TestInstancesWithCinderVolumes-200175985 None] Created volume successfully. Nov 04 18:58:55 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3fa62577-1f69-4989-9445-52155acad689 tempest-GroupSnapshotsTest-592221108 None] Group tempest-GroupSnapshotsTest-Group-521238825: creating Nov 04 18:58:55 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3fa62577-1f69-4989-9445-52155acad689 tempest-GroupSnapshotsTest-592221108 None] Group tempest-GroupSnapshotsTest-Group-521238825: created successfully Nov 04 18:58:55 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3fa62577-1f69-4989-9445-52155acad689 tempest-GroupSnapshotsTest-592221108 None] Create group completed successfully. Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-3c945f0d-85a1-45b3-b48e-257408a219c7 req-b53a4d2f-8f42-4b78-ad05-2e6c444c66b4 tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-3c945f0d-85a1-45b3-b48e-257408a219c7 req-b53a4d2f-8f42-4b78-ad05-2e6c444c66b4 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-3c945f0d-85a1-45b3-b48e-257408a219c7 req-b53a4d2f-8f42-4b78-ad05-2e6c444c66b4 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-3c945f0d-85a1-45b3-b48e-257408a219c7 req-b53a4d2f-8f42-4b78-ad05-2e6c444c66b4 tempest-TestInstancesWithCinderVolumes-200175985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b34bacd2-014e-44f5-994b-737f2ff5396c', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:58:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-3c945f0d-85a1-45b3-b48e-257408a219c7 req-b53a4d2f-8f42-4b78-ad05-2e6c444c66b4 tempest-TestInstancesWithCinderVolumes-200175985 None] attachment_update completed successfully. Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Flow 'volume_create_manager' (a0e4795e-746f-43ab-a607-ec79ccac0e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf11a8e7-fbd1-41fd-9b43-8b7868da9c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf11a8e7-fbd1-41fd-9b43-8b7868da9c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-814223638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49c2ca2b-32d6-4e06-8ad5-d9d2b85f80f4,host='devstack@QuobyteHD#QuobyteHD',id=02a86aa2-5ccc-4c12-b091-f826f6efa895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe04aa6fa6c4db0aa632c86b00a4f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:58Z,use_quota=True,user_id='19d76e1f727b44318e8ccd15e1c4e72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67a7bb35-d5ca-400a-ab8f-9d291a891c29),volume_type_id=67a7bb35-d5ca-400a-ab8f-9d291a891c29)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49861809-3c69-4a67-9475-fc97cae0aa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49861809-3c69-4a67-9475-fc97cae0aa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437eac31-a34e-46fd-b04e-e94da8a5a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437eac31-a34e-46fd-b04e-e94da8a5a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a86aa2-5ccc-4c12-b091-f826f6efa895', 'volume_name': 'volume-02a86aa2-5ccc-4c12-b091-f826f6efa895', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f66ccfa-34c3-4415-b8a4-b4d6fadf9307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f66ccfa-34c3-4415-b8a4-b4d6fadf9307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c17300a-2e37-43d5-ba85-25576f162a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:57 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Volume 02a86aa2-5ccc-4c12-b091-f826f6efa895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a86aa2-5ccc-4c12-b091-f826f6efa895', 'volume_size': 1} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49c2ca2b-32d6-4e06-8ad5-d9d2b85f80f4,created_at=2026-11-04T17:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-814223638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49c2ca2b-32d6-4e06-8ad5-d9d2b85f80f4,host='devstack@QuobyteHD#QuobyteHD',id=02a86aa2-5ccc-4c12-b091-f826f6efa895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe04aa6fa6c4db0aa632c86b00a4f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:58:58Z,use_quota=True,user_id='19d76e1f727b44318e8ccd15e1c4e72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67a7bb35-d5ca-400a-ab8f-9d291a891c29),volume_type_id=67a7bb35-d5ca-400a-ab8f-9d291a891c29)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Creating volume 02a86aa2-5ccc-4c12-b091-f826f6efa895 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:58:57 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:58:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:57 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 1073741824 Nov 04 18:58:57 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:58 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 1073741824" returned: 0 in 0.620s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:58:58 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 Nov 04 18:58:58 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:58:58 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Nov 04 18:58:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895" returned: 0 in 0.311s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:58:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:58:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:58:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c17300a-2e37-43d5-ba85-25576f162a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a86aa2-5ccc-4c12-b091-f826f6efa895', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096a834b-f65e-498d-b538-ace3b36afff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:58:58 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Volume volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 (02a86aa2-5ccc-4c12-b091-f826f6efa895): created successfully Nov 04 18:58:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096a834b-f65e-498d-b538-ace3b36afff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:58:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Flow 'volume_create_manager' (a0e4795e-746f-43ab-a607-ec79ccac0e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:58:58 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6f5febf9-429b-4253-8711-87e017743cba tempest-GroupSnapshotsTest-592221108 None] Created volume successfully. Nov 04 18:59:00 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] GroupSnapshot 7d2fba58-decb-468e-a513-7fcb71d09439: creating. Nov 04 18:59:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] Group snapshot 7d2fba58-decb-468e-a513-7fcb71d09439: creating. {{(pid=87364) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 18:59:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] Creating offline snapshot 762e7ecd-1cea-4068-ad43-7bc6a3923ad7 of volume 02a86aa2-5ccc-4c12-b091-f826f6efa895 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:59:01 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efd6065-8607-46b6-9b6c-ea4de68d4744]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:01 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 Nov 04 18:59:01 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:01 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895" returned: 0 in 0.788s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:01 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 1G Nov 04 18:59:01 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Flow 'volume_create_manager' (952e1422-f90a-49f2-8f0e-3e9405c390ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f3683d-e13d-4c22-a5a9-83c8af488e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f3683d-e13d-4c22-a5a9-83c8af488e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1920481634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b709736-61e6-43a8-8333-076552cf06c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3bd7137b5d4940aa9d3656b3f8af08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:03Z,use_quota=True,user_id='45bcb58dfef744499f0089459a8b471c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa0d938-23ee-4b12-9c17-5c40b473e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa0d938-23ee-4b12-9c17-5c40b473e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0bf025-569a-402b-ad44-f6229d144683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0bf025-569a-402b-ad44-f6229d144683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b709736-61e6-43a8-8333-076552cf06c1', 'volume_name': 'volume-9b709736-61e6-43a8-8333-076552cf06c1', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6dc0db-fe6e-41d2-9a85-b2f2b2821cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6dc0db-fe6e-41d2-9a85-b2f2b2821cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cb6c0d-11ca-4fa2-bffd-c3ce601fc3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:02 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Volume 9b709736-61e6-43a8-8333-076552cf06c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b709736-61e6-43a8-8333-076552cf06c1', 'volume_size': 1} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:02 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 1G" returned: 0 in 0.889s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:02 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 Nov 04 18:59:02 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:03 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7" returned: 0 in 0.449s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:03 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:59:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:03 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 Nov 04 18:59:03 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:03 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7" returned: 0 in 0.451s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:03 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.info Nov 04 18:59:03 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:04 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.info" returned: 0 in 0.606s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:04 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:04 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.info Nov 04 18:59:04 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:04 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.info" returned: 0 in 0.343s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.793s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.058s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1920481634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b709736-61e6-43a8-8333-076552cf06c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3bd7137b5d4940aa9d3656b3f8af08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:03Z,use_quota=True,user_id='45bcb58dfef744499f0089459a8b471c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Creating volume 9b709736-61e6-43a8-8333-076552cf06c1 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:59:04 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:59:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:04 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1 1073741824 Nov 04 18:59:04 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-725e85ac-b1c1-4af2-92c6-c8e5be4bbdcc tempest-GroupSnapshotsTest-592221108 None] group_snapshot 7d2fba58-decb-468e-a513-7fcb71d09439: created successfully Nov 04 18:59:05 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1 1073741824" returned: 0 in 0.959s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:05 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1 Nov 04 18:59:05 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:06 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1" returned: 0 in 0.726s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cb6c0d-11ca-4fa2-bffd-c3ce601fc3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b709736-61e6-43a8-8333-076552cf06c1', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ea6948-add6-470d-9e6d-07ed2cc33ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:06 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Volume volume-9b709736-61e6-43a8-8333-076552cf06c1 (9b709736-61e6-43a8-8333-076552cf06c1): created successfully Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ea6948-add6-470d-9e6d-07ed2cc33ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Flow 'volume_create_manager' (952e1422-f90a-49f2-8f0e-3e9405c390ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:06 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-423230f7-08ce-4a83-a220-b7345b63d1f0 tempest-AttachVolumeNegativeTest-946051108 None] Created volume successfully. Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-762e7ecd-1cea-4068-ad43-7bc6a3923ad7-bae74070-a6a5-47b4-b6a9-13464120c363" by "_create_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-762e7ecd-1cea-4068-ad43-7bc6a3923ad7-bae74070-a6a5-47b4-b6a9-13464120c363" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Creating volume bae74070-a6a5-47b4-b6a9-13464120c363 from snapshot 762e7ecd-1cea-4068-ad43-7bc6a3923ad7 {{(pid=87364) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:59:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-bae74070-a6a5-47b4-b6a9-13464120c363" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-bae74070-a6a5-47b4-b6a9-13464120c363" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] snapshot: 762e7ecd-1cea-4068-ad43-7bc6a3923ad7, volume: bae74070-a6a5-47b4-b6a9-13464120c363, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea16f704-71b2-4cae-ab21-40f023ba8f0f]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:07 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 Nov 04 18:59:07 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:07 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7" returned: 0 in 0.644s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02a86aa2-5ccc-4c12-b091-f826f6efa895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45856f2-418a-4fa7-8cb9-148cc9d0ba8f]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:08 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 Nov 04 18:59:08 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:08 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895" returned: 0 in 1.100s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 18:59:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 18:59:08 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363 not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 18:59:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:09 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363 Nov 04 18:59:09 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-155f1ec0-6de8-4aac-81c0-ff234037f32e req-f3005369-f69e-496e-b0f3-6ce3ca6989cd tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:59:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:16 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:59:16 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:17 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 1.341s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:17 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:17 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 18:59:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 18:59:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 18:59:19 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=49,cinder:INSERT=12,cinder:UPDATE=48,cinder:DELETE=4 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:59:19 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=53,cinder:UPDATE=48,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 18:59:21 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363" returned: 0 in 12.286s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:21 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895, size 1024.00 MB, duration 12.29 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 18:59:21 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Converted 1024.00 MB image at 83.34 MB/s Nov 04 18:59:21 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:59:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:21 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363 Nov 04 18:59:21 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:21 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363" returned: 0 in 0.394s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-bae74070-a6a5-47b4-b6a9-13464120c363" released by "_copy_volume_from_snapshot" :: held 14.615s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-762e7ecd-1cea-4068-ad43-7bc6a3923ad7-bae74070-a6a5-47b4-b6a9-13464120c363" released by "_create_volume_from_snapshot" :: held 14.764s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.809s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-155f1ec0-6de8-4aac-81c0-ff234037f32e req-f3005369-f69e-496e-b0f3-6ce3ca6989cd tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.951s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-155f1ec0-6de8-4aac-81c0-ff234037f32e req-f3005369-f69e-496e-b0f3-6ce3ca6989cd tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-155f1ec0-6de8-4aac-81c0-ff234037f32e req-f3005369-f69e-496e-b0f3-6ce3ca6989cd tempest-AttachVolumeNegativeTest-946051108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-9b709736-61e6-43a8-8333-076552cf06c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad138ca5-1835-452c-bb88-1fea4a608f04', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:59:21 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f456c84c-e37f-4608-bc98-18f34b97fb04 tempest-GroupSnapshotsTest-592221108 None] Create group from source-snapshot-7d2fba58-decb-468e-a513-7fcb71d09439 completed successfully. Nov 04 18:59:21 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-155f1ec0-6de8-4aac-81c0-ff234037f32e req-f3005369-f69e-496e-b0f3-6ce3ca6989cd tempest-AttachVolumeNegativeTest-946051108 None] attachment_update completed successfully. Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Flow 'volume_create_manager' (9433209f-8fad-4d37-b098-29215fa22853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82f26e8-f397-43a9-9ab6-6fda6859f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82f26e8-f397-43a9-9ab6-6fda6859f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1431158759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917d2129-ff82-4f63-97df-3cffd774a841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258b6b74f50e4f6eac9dd5ad905d894b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:23Z,use_quota=True,user_id='dd40e6d1ad2b49668220843ef0c0b82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff34333-7229-4e5e-ad56-dc663353219b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff34333-7229-4e5e-ad56-dc663353219b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4711be0d-daa1-470f-a626-5c027361eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4711be0d-daa1-470f-a626-5c027361eab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '917d2129-ff82-4f63-97df-3cffd774a841', 'volume_name': 'volume-917d2129-ff82-4f63-97df-3cffd774a841', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56952204-50b2-47af-ab0c-a500c630ace2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56952204-50b2-47af-ab0c-a500c630ace2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d5c6f6-71a4-4a5a-8076-f6f384312b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:23 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Volume 917d2129-ff82-4f63-97df-3cffd774a841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-917d2129-ff82-4f63-97df-3cffd774a841', 'volume_size': 1} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1431158759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917d2129-ff82-4f63-97df-3cffd774a841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258b6b74f50e4f6eac9dd5ad905d894b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:23Z,use_quota=True,user_id='dd40e6d1ad2b49668220843ef0c0b82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Creating volume 917d2129-ff82-4f63-97df-3cffd774a841 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:59:23 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:23 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 1073741824 Nov 04 18:59:23 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-bae74070-a6a5-47b4-b6a9-13464120c363" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-bae74070-a6a5-47b4-b6a9-13464120c363" acquired by "delete_volume" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[962e946b-2d7a-4ba6-9eaf-368e89aafefd]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:23 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363 Nov 04 18:59:23 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:24 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 1073741824" returned: 0 in 0.784s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:24 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 Nov 04 18:59:24 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:24 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363" returned: 0 in 0.642s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:24 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363 Nov 04 18:59:24 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:24 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841" returned: 0 in 0.348s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d5c6f6-71a4-4a5a-8076-f6f384312b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917d2129-ff82-4f63-97df-3cffd774a841', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61ec376-d45c-4057-b86e-194d9443947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-0ca6df83-7d81-4bd7-b5ab-c088fc70519f req-3c4e3de5-fd01-46cd-a8db-958be604eac5 tempest-AttachVolumeNegativeTest-946051108 None] Terminate volume connection completed successfully. Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-0ca6df83-7d81-4bd7-b5ab-c088fc70519f req-3c4e3de5-fd01-46cd-a8db-958be604eac5 tempest-AttachVolumeNegativeTest-946051108 None] Deleting attachment ad138ca5-1835-452c-bb88-1fea4a608f04. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:59:24 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Volume volume-917d2129-ff82-4f63-97df-3cffd774a841 (917d2129-ff82-4f63-97df-3cffd774a841): created successfully Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61ec376-d45c-4057-b86e-194d9443947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Flow 'volume_create_manager' (9433209f-8fad-4d37-b098-29215fa22853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3dd38e8f-6766-4686-bbb7-4b83306a8ac1 tempest-VolumesActionsTest-795650821 None] Created volume successfully. Nov 04 18:59:24 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bae74070-a6a5-47b4-b6a9-13464120c363" returned: 0 in 0.278s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-bae74070-a6a5-47b4-b6a9-13464120c363" released by "delete_volume" :: held 0.983s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Created reservations ['00217613-1c47-4970-9db2-96405197d615'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:24 devstack cinder-volume[87364]: WARNING cinder.quota [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-498542258 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-498542258, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:59:24 devstack cinder-volume[87364]: WARNING cinder.quota [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-498542258 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-498542258, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Created reservations ['18a5cca8-7c37-4c32-8027-3dc8da4fc11c', '16e9c037-6138-4102-8f3f-e823f49b89c6', '36219eba-85ab-4d1d-be33-f3142260a25e', 'a5a6e6df-3cfd-4527-98b3-9472b46578da'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:24 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:59:24 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:25 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:25 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] group_snapshot 7d2fba58-decb-468e-a513-7fcb71d09439: deleting Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.283s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:25 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-88138007-5f1a-4cd6-9380-ee8c26f28052 tempest-GroupSnapshotsTest-592221108 None] Delete group completed successfully. Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] group_snapshot 7d2fba58-decb-468e-a513-7fcb71d09439: deleting {{(pid=87364) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-02a86aa2-5ccc-4c12-b091-f826f6efa895" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-02a86aa2-5ccc-4c12-b091-f826f6efa895" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-762e7ecd-1cea-4068-ad43-7bc6a3923ad7" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-762e7ecd-1cea-4068-ad43-7bc6a3923ad7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Deleting offline snapshot 762e7ecd-1cea-4068-ad43-7bc6a3923ad7 of volume 02a86aa2-5ccc-4c12-b091-f826f6efa895 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] snapshot_file for this snap is: volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ccd5b5-9ba4-42ed-bdae-e7ae1df13fbc]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:25 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 Nov 04 18:59:25 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:25 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7" returned: 0 in 0.475s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02a86aa2-5ccc-4c12-b091-f826f6efa895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fb6f42-1a87-4f51-a126-ab1c8805655c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:26 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 Nov 04 18:59:26 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:26 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895" returned: 0 in 0.887s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:26 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 Nov 04 18:59:26 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:27 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7" returned: 0 in 0.551s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:27 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7 Nov 04 18:59:27 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:27 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895.762e7ecd-1cea-4068-ad43-7bc6a3923ad7" returned: 0 in 0.355s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-762e7ecd-1cea-4068-ad43-7bc6a3923ad7" released by "_delete_snapshot" :: held 2.440s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-02a86aa2-5ccc-4c12-b091-f826f6efa895" released by "delete_snapshot" :: held 2.470s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:27 devstack cinder-volume[87364]: WARNING cinder.quota [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-498542258 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-498542258, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:59:27 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] Created reservations ['ad2e7c6d-e703-4986-82b9-a4af24b8543a', '94848dc9-3445-49b6-a5ad-fe4ac308429d', '36880da7-ae23-426a-9573-b1806a7fd4fc', 'b4adfe81-3332-483e-ad3c-6012682e531a'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:27 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-802c0d5a-4844-4d96-b655-1dbf22665a7c tempest-GroupSnapshotsTest-592221108 None] group_snapshot 7d2fba58-decb-468e-a513-7fcb71d09439: deleted successfully Nov 04 18:59:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-02a86aa2-5ccc-4c12-b091-f826f6efa895" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-02a86aa2-5ccc-4c12-b091-f826f6efa895" acquired by "delete_volume" :: waited 0.052s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:29 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3375af-f873-47e2-be53-a466b8f0dbdc]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:29 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 Nov 04 18:59:29 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:29 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895" returned: 0 in 0.458s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:29 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895 Nov 04 18:59:29 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:30 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-02a86aa2-5ccc-4c12-b091-f826f6efa895" returned: 0 in 0.325s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-02a86aa2-5ccc-4c12-b091-f826f6efa895" released by "delete_volume" :: held 0.927s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Created reservations ['c4cf6c1e-fb33-4c2f-95b0-f7fdfeb6c16d'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:30 devstack cinder-volume[87364]: WARNING cinder.db.api [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-498542258'] Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Created reservations ['920e5029-2e89-41f2-90c4-5425b34b5229', 'e243c779-a842-46b5-9b89-60c641f299c9', '9304eb2f-2dfb-4287-a95f-6c98391bf2d5', '1b52afd8-e285-4373-ae28-c916763b2d59'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:30 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:59:30 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:30 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.411s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:30 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:30 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9e7d8c5f-f12a-439d-99d0-e2bb16dcf393 tempest-GroupSnapshotsTest-592221108 None] Delete group completed successfully. Nov 04 18:59:31 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ec920171-0ca4-4f86-b504-007f96be84a1 tempest-GroupSnapshotsTest-592221108 None] Group tempest-GroupSnapshotsTest-Group-197771437: creating Nov 04 18:59:31 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ec920171-0ca4-4f86-b504-007f96be84a1 tempest-GroupSnapshotsTest-592221108 None] Group tempest-GroupSnapshotsTest-Group-197771437: created successfully Nov 04 18:59:31 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ec920171-0ca4-4f86-b504-007f96be84a1 tempest-GroupSnapshotsTest-592221108 None] Create group completed successfully. Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Flow 'volume_create_manager' (f79387af-e0d2-45bb-a992-0d03a47cfd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f93ed5b-c92a-4a70-a856-0691163dbf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f93ed5b-c92a-4a70-a856-0691163dbf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-911234120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89a029b3-1b9e-48cf-9097-f112f432fa26,host='devstack@QuobyteHD#QuobyteHD',id=72c74f56-3438-46f4-ba36-923bb7c3dc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe04aa6fa6c4db0aa632c86b00a4f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:34Z,use_quota=True,user_id='19d76e1f727b44318e8ccd15e1c4e72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e5a5bc4-4033-4fc7-8bb7-003ea45e79fe),volume_type_id=2e5a5bc4-4033-4fc7-8bb7-003ea45e79fe)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c79aae-ac81-4135-b7b1-d36365e70fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c79aae-ac81-4135-b7b1-d36365e70fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b1d788-f154-4eab-bc65-25542b53a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b1d788-f154-4eab-bc65-25542b53a330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c74f56-3438-46f4-ba36-923bb7c3dc89', 'volume_name': 'volume-72c74f56-3438-46f4-ba36-923bb7c3dc89', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6519e225-cd78-4d5d-8935-9317764158e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6519e225-cd78-4d5d-8935-9317764158e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf5d97c-3adf-450d-9f63-b9cefe2f64d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:34 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Volume 72c74f56-3438-46f4-ba36-923bb7c3dc89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c74f56-3438-46f4-ba36-923bb7c3dc89', 'volume_size': 1} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89a029b3-1b9e-48cf-9097-f112f432fa26,created_at=2026-11-04T17:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-911234120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89a029b3-1b9e-48cf-9097-f112f432fa26,host='devstack@QuobyteHD#QuobyteHD',id=72c74f56-3438-46f4-ba36-923bb7c3dc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe04aa6fa6c4db0aa632c86b00a4f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:34Z,use_quota=True,user_id='19d76e1f727b44318e8ccd15e1c4e72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e5a5bc4-4033-4fc7-8bb7-003ea45e79fe),volume_type_id=2e5a5bc4-4033-4fc7-8bb7-003ea45e79fe)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Creating volume 72c74f56-3438-46f4-ba36-923bb7c3dc89 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:59:34 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:59:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:34 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 1073741824 Nov 04 18:59:34 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:35 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 1073741824" returned: 0 in 1.077s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:35 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 Nov 04 18:59:35 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:35 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89" returned: 0 in 0.362s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:59:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf5d97c-3adf-450d-9f63-b9cefe2f64d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c74f56-3438-46f4-ba36-923bb7c3dc89', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effb7097-690c-4bc3-8ed4-cecc286621c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:36 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Volume volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 (72c74f56-3438-46f4-ba36-923bb7c3dc89): created successfully Nov 04 18:59:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effb7097-690c-4bc3-8ed4-cecc286621c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Flow 'volume_create_manager' (f79387af-e0d2-45bb-a992-0d03a47cfd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-d9312027-43c6-4bed-9c72-3ec14942cdd4 req-04d60db1-a9a3-4fd0-a31b-3ba909df7d3f tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-d9312027-43c6-4bed-9c72-3ec14942cdd4 req-04d60db1-a9a3-4fd0-a31b-3ba909df7d3f tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7baccfa6-3936-4a43-93f2-d4e36b3e498a tempest-GroupSnapshotsTest-592221108 None] Created volume successfully. Nov 04 18:59:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-d9312027-43c6-4bed-9c72-3ec14942cdd4 req-04d60db1-a9a3-4fd0-a31b-3ba909df7d3f tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-d9312027-43c6-4bed-9c72-3ec14942cdd4 req-04d60db1-a9a3-4fd0-a31b-3ba909df7d3f tempest-TestInstancesWithCinderVolumes-200175985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-6e34e763-184e-4102-8ed8-898e52ee2551', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01f94de7-a140-4a41-9d71-e4196982cfab', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:59:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-d9312027-43c6-4bed-9c72-3ec14942cdd4 req-04d60db1-a9a3-4fd0-a31b-3ba909df7d3f tempest-TestInstancesWithCinderVolumes-200175985 None] attachment_update completed successfully. Nov 04 18:59:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-98edda19-b6fb-42f9-9e88-9a2ed71a90f7 tempest-VolumesActionsTest-795650821 None] Acquiring lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841" by "attach_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-98edda19-b6fb-42f9-9e88-9a2ed71a90f7 tempest-VolumesActionsTest-795650821 None] Lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841" acquired by "attach_volume" :: waited 0.029s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-98edda19-b6fb-42f9-9e88-9a2ed71a90f7 tempest-VolumesActionsTest-795650821 None] Attaching volume 917d2129-ff82-4f63-97df-3cffd774a841 to instance 19b7241f-cf2b-4453-9c55-574d165cfacf at mountpoint /dev/vdb on host None. Nov 04 18:59:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-98edda19-b6fb-42f9-9e88-9a2ed71a90f7 tempest-VolumesActionsTest-795650821 None] Attach volume completed successfully. Nov 04 18:59:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-98edda19-b6fb-42f9-9e88-9a2ed71a90f7 tempest-VolumesActionsTest-795650821 None] Lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841" released by "attach_volume" :: held 0.195s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f5411b5d-c6db-4a51-9283-6b6022a0b7a0 tempest-VolumesActionsTest-795650821 None] Acquiring lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841-detach_volume" by "detach_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f5411b5d-c6db-4a51-9283-6b6022a0b7a0 tempest-VolumesActionsTest-795650821 None] Lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f5411b5d-c6db-4a51-9283-6b6022a0b7a0 tempest-VolumesActionsTest-795650821 None] Detaching volume 917d2129-ff82-4f63-97df-3cffd774a841 from instance 19b7241f-cf2b-4453-9c55-574d165cfacf. Nov 04 18:59:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f5411b5d-c6db-4a51-9283-6b6022a0b7a0 tempest-VolumesActionsTest-795650821 None] Detach volume completed successfully. Nov 04 18:59:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f5411b5d-c6db-4a51-9283-6b6022a0b7a0 tempest-VolumesActionsTest-795650821 None] Lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Flow 'volume_create_manager' (719aaa6a-406f-4bcc-8d19-52c381ae20c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91fbffa-d25e-4142-99e9-0d1c9badc072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91fbffa-d25e-4142-99e9-0d1c9badc072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T17:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-465478684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89a029b3-1b9e-48cf-9097-f112f432fa26,host='devstack@QuobyteHD#QuobyteHD',id=ffaddc55-e93c-4f42-9368-cef9a44d6567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe04aa6fa6c4db0aa632c86b00a4f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:38Z,use_quota=True,user_id='19d76e1f727b44318e8ccd15e1c4e72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e5a5bc4-4033-4fc7-8bb7-003ea45e79fe),volume_type_id=2e5a5bc4-4033-4fc7-8bb7-003ea45e79fe)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155ebaf1-3814-4526-b3ce-acb3dcffe39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155ebaf1-3814-4526-b3ce-acb3dcffe39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1d85cf-d1b1-4225-b541-8b56338c1d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1d85cf-d1b1-4225-b541-8b56338c1d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffaddc55-e93c-4f42-9368-cef9a44d6567', 'volume_name': 'volume-ffaddc55-e93c-4f42-9368-cef9a44d6567', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d5e855-e973-45a6-a443-5ad13fad20a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d5e855-e973-45a6-a443-5ad13fad20a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ff72b8-1711-4e90-9636-61183fdd4e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:38 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Volume ffaddc55-e93c-4f42-9368-cef9a44d6567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffaddc55-e93c-4f42-9368-cef9a44d6567', 'volume_size': 1} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89a029b3-1b9e-48cf-9097-f112f432fa26,created_at=2026-11-04T17:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-465478684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89a029b3-1b9e-48cf-9097-f112f432fa26,host='devstack@QuobyteHD#QuobyteHD',id=ffaddc55-e93c-4f42-9368-cef9a44d6567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe04aa6fa6c4db0aa632c86b00a4f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T17:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T17:59:38Z,use_quota=True,user_id='19d76e1f727b44318e8ccd15e1c4e72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e5a5bc4-4033-4fc7-8bb7-003ea45e79fe),volume_type_id=2e5a5bc4-4033-4fc7-8bb7-003ea45e79fe)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Creating volume ffaddc55-e93c-4f42-9368-cef9a44d6567 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 18:59:38 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 18:59:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:38 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 1073741824 Nov 04 18:59:38 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:39 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 1073741824" returned: 0 in 0.800s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:39 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 Nov 04 18:59:39 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:39 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567" returned: 0 in 0.457s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 18:59:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ff72b8-1711-4e90-9636-61183fdd4e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffaddc55-e93c-4f42-9368-cef9a44d6567', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ff5b87-0231-4f78-9a80-3e1fa04b3ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 18:59:39 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Volume volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 (ffaddc55-e93c-4f42-9368-cef9a44d6567): created successfully Nov 04 18:59:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ff5b87-0231-4f78-9a80-3e1fa04b3ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 18:59:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Flow 'volume_create_manager' (719aaa6a-406f-4bcc-8d19-52c381ae20c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 18:59:39 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1d4ac40d-9854-476d-9447-230e63a1fe8e tempest-GroupSnapshotsTest-592221108 None] Created volume successfully. Nov 04 18:59:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-d09499be-485e-4cc8-b64b-fd7e2cdd1561 req-afe80551-9b18-4a6c-ba42-4c84e45273ec tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-d09499be-485e-4cc8-b64b-fd7e2cdd1561 req-afe80551-9b18-4a6c-ba42-4c84e45273ec tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-d09499be-485e-4cc8-b64b-fd7e2cdd1561 req-afe80551-9b18-4a6c-ba42-4c84e45273ec tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-d09499be-485e-4cc8-b64b-fd7e2cdd1561 req-afe80551-9b18-4a6c-ba42-4c84e45273ec tempest-TestInstancesWithCinderVolumes-200175985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d0ee395-fe5d-4d3c-9799-d79007aa4212', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 18:59:40 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-d09499be-485e-4cc8-b64b-fd7e2cdd1561 req-afe80551-9b18-4a6c-ba42-4c84e45273ec tempest-TestInstancesWithCinderVolumes-200175985 None] attachment_update completed successfully. Nov 04 18:59:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-777385c8-a680-41fb-a426-79f1525262c4 tempest-GroupSnapshotsTest-592221108 None] Update group completed successfully. Nov 04 18:59:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d7a78a4f-d60c-4ff4-b36c-1b9350e1efa1 tempest-GroupSnapshotsTest-592221108 None] Update group completed successfully. Nov 04 18:59:44 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-19e0edc6-860e-4e64-b349-8f7218b25299 tempest-GroupSnapshotsTest-592221108 None] Update group completed successfully. Nov 04 18:59:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-924a8e82-dc09-4916-8859-ba19db10b340 tempest-GroupSnapshotsTest-592221108 None] Update group completed successfully. Nov 04 18:59:47 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] GroupSnapshot 0a94fb55-c621-437d-82dd-e06d12e6e378: creating. Nov 04 18:59:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Group snapshot 0a94fb55-c621-437d-82dd-e06d12e6e378: creating. {{(pid=87364) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 18:59:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Creating offline snapshot 3e71acb2-5a69-45c4-a4fb-8fa133b101e1 of volume 72c74f56-3438-46f4-ba36-923bb7c3dc89 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:59:48 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[75470437-b262-46fb-9539-046c43c6e1fb]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:48 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 Nov 04 18:59:48 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:48 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89" returned: 0 in 0.588s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:48 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-ca356347-5c50-43d8-9936-413090651e40 req-92d9e852-3fb3-4b56-aee9-06b0d47b8d7b tempest-TestInstancesWithCinderVolumes-200175985 None] Terminate volume connection completed successfully. Nov 04 18:59:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-ca356347-5c50-43d8-9936-413090651e40 req-92d9e852-3fb3-4b56-aee9-06b0d47b8d7b tempest-TestInstancesWithCinderVolumes-200175985 None] Deleting attachment 01f94de7-a140-4a41-9d71-e4196982cfab. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:59:48 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 1G Nov 04 18:59:48 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "cinder-6e34e763-184e-4102-8ed8-898e52ee2551-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-6e34e763-184e-4102-8ed8-898e52ee2551-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "cinder-quobyte-6e34e763-184e-4102-8ed8-898e52ee2551" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-quobyte-6e34e763-184e-4102-8ed8-898e52ee2551" acquired by "delete_volume" :: waited 0.050s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:49 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa25bf3-3151-48ce-a719-ec0d32cbe538]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:49 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 1G" returned: 0 in 0.898s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:49 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 Nov 04 18:59:49 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:49 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551 Nov 04 18:59:49 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:50 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1" returned: 0 in 0.717s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:50 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:59:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:50 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 Nov 04 18:59:50 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:50 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551" returned: 0 in 0.993s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:50 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551 Nov 04 18:59:50 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:50 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1" returned: 0 in 0.601s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:51 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.info Nov 04 18:59:51 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:51 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e34e763-184e-4102-8ed8-898e52ee2551" returned: 0 in 0.597s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-quobyte-6e34e763-184e-4102-8ed8-898e52ee2551" released by "delete_volume" :: held 1.722s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:51 devstack cinder-volume[87364]: WARNING cinder.quota [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-265414151-295747205 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-265414151-295747205, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:59:51 devstack cinder-volume[87364]: WARNING cinder.quota [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-265414151-295747205 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-265414151-295747205, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:59:51 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Created reservations ['57fe7e70-4d94-40e0-83ca-7117a0129f16', '7dda324d-aeb4-459f-8a9e-dcf87df88653', 'ab61252c-ca40-4192-9190-6097fd73f2d8', '4dc07ff6-cd25-415e-b4ea-234b5de9953d'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:51 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.info" returned: 0 in 1.074s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:52 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:59:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:52 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:59:52 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:52 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.info Nov 04 18:59:52 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:53 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 1.071s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:53 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 18:59:53 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Deleted volume successfully. Nov 04 18:59:53 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.info" returned: 0 in 1.107s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.228s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bd355ccc-df96-4889-ac7d-862e536a025e tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-6e34e763-184e-4102-8ed8-898e52ee2551-delete_volume" released by "delete_volume" :: held 3.925s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Creating offline snapshot 59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b of volume ffaddc55-e93c-4f42-9368-cef9a44d6567 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 18:59:53 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3e2ad1-8ca8-4e37-aeae-6a89d2988bd0]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:53 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 Nov 04 18:59:53 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:54 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567" returned: 0 in 0.813s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:54 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b 1G Nov 04 18:59:54 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:55 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b 1G" returned: 0 in 1.078s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:55 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b Nov 04 18:59:55 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:55 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b" returned: 0 in 0.440s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:55 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:59:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:55 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b Nov 04 18:59:55 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d1cbb29d-083d-4be1-8c5f-25dcb4c14b56 tempest-VolumesActionsTest-795650821 None] Acquiring lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841" by "attach_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d1cbb29d-083d-4be1-8c5f-25dcb4c14b56 tempest-VolumesActionsTest-795650821 None] Lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841" acquired by "attach_volume" :: waited 0.045s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:56 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b" returned: 0 in 0.640s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:56 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.info Nov 04 18:59:56 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d1cbb29d-083d-4be1-8c5f-25dcb4c14b56 tempest-VolumesActionsTest-795650821 None] Attaching volume 917d2129-ff82-4f63-97df-3cffd774a841 to instance a0ee51c1-bade-4045-9535-c0d956d73c15 at mountpoint /dev/vdb on host None. Nov 04 18:59:56 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:56 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d1cbb29d-083d-4be1-8c5f-25dcb4c14b56 tempest-VolumesActionsTest-795650821 None] Attach volume completed successfully. Nov 04 18:59:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d1cbb29d-083d-4be1-8c5f-25dcb4c14b56 tempest-VolumesActionsTest-795650821 None] Lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841" released by "attach_volume" :: held 0.177s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:56 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-043b8975-1433-4f66-a710-88362f9c1d4f req-afa2842d-9ce9-49bd-8ea2-40ad39d1aebd tempest-TestInstancesWithCinderVolumes-200175985 None] Terminate volume connection completed successfully. Nov 04 18:59:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-043b8975-1433-4f66-a710-88362f9c1d4f req-afa2842d-9ce9-49bd-8ea2-40ad39d1aebd tempest-TestInstancesWithCinderVolumes-200175985 None] Deleting attachment 6d0ee395-fe5d-4d3c-9799-d79007aa4212. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 18:59:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-295c2e1c-03cb-40a4-8cae-34963e638b7c tempest-VolumesActionsTest-795650821 None] Acquiring lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841-detach_volume" by "detach_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-295c2e1c-03cb-40a4-8cae-34963e638b7c tempest-VolumesActionsTest-795650821 None] Lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841-detach_volume" acquired by "detach_volume" :: waited 0.060s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-295c2e1c-03cb-40a4-8cae-34963e638b7c tempest-VolumesActionsTest-795650821 None] Detaching volume 917d2129-ff82-4f63-97df-3cffd774a841 from instance a0ee51c1-bade-4045-9535-c0d956d73c15. Nov 04 18:59:57 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.info" returned: 0 in 0.719s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:57 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:57 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.info Nov 04 18:59:57 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-295c2e1c-03cb-40a4-8cae-34963e638b7c tempest-VolumesActionsTest-795650821 None] Detach volume completed successfully. Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-295c2e1c-03cb-40a4-8cae-34963e638b7c tempest-VolumesActionsTest-795650821 None] Lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841-detach_volume" released by "detach_volume" :: held 0.191s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "cinder-5ab87981-7e07-4f35-b4e1-102c3d8dca5a-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-5ab87981-7e07-4f35-b4e1-102c3d8dca5a-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "cinder-quobyte-5ab87981-7e07-4f35-b4e1-102c3d8dca5a" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-quobyte-5ab87981-7e07-4f35-b4e1-102c3d8dca5a" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:57 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.info" returned: 0 in 0.511s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.385s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db73715-160f-4f12-bf2d-4f2a985c501b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:57 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a Nov 04 18:59:57 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-27779c0d-d0bb-44c8-8c0f-15b6eca51891 tempest-GroupSnapshotsTest-592221108 None] group_snapshot 0a94fb55-c621-437d-82dd-e06d12e6e378: created successfully Nov 04 18:59:58 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a" returned: 0 in 0.965s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:58 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a Nov 04 18:59:58 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:58 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] group_snapshot 0a94fb55-c621-437d-82dd-e06d12e6e378: deleting Nov 04 18:59:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] group_snapshot 0a94fb55-c621-437d-82dd-e06d12e6e378: deleting {{(pid=87364) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 18:59:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-72c74f56-3438-46f4-ba36-923bb7c3dc89" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-72c74f56-3438-46f4-ba36-923bb7c3dc89" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-3e71acb2-5a69-45c4-a4fb-8fa133b101e1" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 18:59:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-3e71acb2-5a69-45c4-a4fb-8fa133b101e1" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 18:59:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Deleting offline snapshot 3e71acb2-5a69-45c4-a4fb-8fa133b101e1 of volume 72c74f56-3438-46f4-ba36-923bb7c3dc89 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 18:59:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] snapshot_file for this snap is: volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 18:59:58 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c234239-5678-4280-9cb9-d2abec337581]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:59 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5ab87981-7e07-4f35-b4e1-102c3d8dca5a" returned: 0 in 0.589s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:59 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-quobyte-5ab87981-7e07-4f35-b4e1-102c3d8dca5a" released by "delete_volume" :: held 1.713s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 18:59:59 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:59 devstack cinder-volume[87364]: WARNING cinder.quota [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898145362-1844387923 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898145362-1844387923, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:59:59 devstack cinder-volume[87364]: WARNING cinder.quota [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898145362-1844387923 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898145362-1844387923, it is now deprecated. Please use the default quota class for default quota. Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Created reservations ['3acc8cd5-4774-4de5-a651-21cb9a6a6b75', '17a810fe-2a6c-4cbb-9851-d75dc3a0a4cc', '1096bb88-ca32-4792-a852-61fa0fae3bab', 'e46c4fc7-015e-4b38-9298-a9a7ee7ba489'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 18:59:59 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 18:59:59 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 18:59:59 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1" returned: 0 in 0.752s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72c74f56-3438-46f4-ba36-923bb7c3dc89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c82e51-5cd2-4809-9e6d-16b5cc0ebdb8]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 18:59:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:00 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 Nov 04 19:00:00 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:00 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.536s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:00 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:00 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Deleted volume successfully. Nov 04 19:00:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aca6aa36-64b2-46c2-bf77-c9e9e5e1c99f tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-5ab87981-7e07-4f35-b4e1-102c3d8dca5a-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:00 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89" returned: 0 in 0.732s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:00 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 Nov 04 19:00:00 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:00 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1" returned: 0 in 0.429s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:01 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1 Nov 04 19:00:01 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:01 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89.3e71acb2-5a69-45c4-a4fb-8fa133b101e1" returned: 0 in 0.291s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-3e71acb2-5a69-45c4-a4fb-8fa133b101e1" released by "_delete_snapshot" :: held 2.441s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-72c74f56-3438-46f4-ba36-923bb7c3dc89" released by "delete_snapshot" :: held 2.489s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-ffaddc55-e93c-4f42-9368-cef9a44d6567" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-ffaddc55-e93c-4f42-9368-cef9a44d6567" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Deleting offline snapshot 59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b of volume ffaddc55-e93c-4f42-9368-cef9a44d6567 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] snapshot_file for this snap is: volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[60578ef9-46e9-421b-8923-cff9b9b4b182]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:01 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b Nov 04 19:00:01 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:01 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b" returned: 0 in 0.503s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffaddc55-e93c-4f42-9368-cef9a44d6567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:00:02 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8758c585-3263-416d-a241-03d18ae45320]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:02 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 Nov 04 19:00:02 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:02 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567" returned: 0 in 0.534s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:02 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b Nov 04 19:00:02 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:03 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b" returned: 0 in 0.563s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:03 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b Nov 04 19:00:03 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:03 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567.59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b" returned: 0 in 0.413s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-59a4cbe9-1f28-4db0-b26a-fcd79f48ce7b" released by "_delete_snapshot" :: held 2.213s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-ffaddc55-e93c-4f42-9368-cef9a44d6567" released by "delete_snapshot" :: held 2.241s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:03 devstack cinder-volume[87364]: WARNING cinder.quota [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1200468157 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1200468157, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:03 devstack cinder-volume[87364]: WARNING cinder.quota [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1200468157 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1200468157, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:03 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Created reservations ['3dfbe573-6ab5-43ce-987b-726e8da6162a', 'c16b76d7-fd78-4e4e-84f3-8e32409c697f', 'ab7d0bb5-83f3-4cbf-b230-91bc725478d8', 'a086abe2-4c7d-4ce7-a9b1-e1f21e8d4d0b'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:04 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] Created reservations ['6c4ee905-090a-40b9-bc1c-ce7a0dfbd18d', 'd600c76e-127e-4ebf-af40-3e1fb3f29e2e', 'ee788688-bdbe-4857-88f1-ada68c51c7a1', 'a8654c05-995b-473a-b103-206750b6fd53'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:04 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c59a979d-9a48-4ace-92a5-da9885cc0efc tempest-GroupSnapshotsTest-592221108 None] group_snapshot 0a94fb55-c621-437d-82dd-e06d12e6e378: deleted successfully Nov 04 19:00:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:04 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eac126-b997-4591-8933-638545dd4c8c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:04 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 Nov 04 19:00:04 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:04 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-090deaf6-b0cb-43b7-84e2-414b0dd7915a req-344be0b6-38ba-4be5-82d0-3748e633bdd3 tempest-TestInstancesWithCinderVolumes-200175985 None] Terminate volume connection completed successfully. Nov 04 19:00:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-090deaf6-b0cb-43b7-84e2-414b0dd7915a req-344be0b6-38ba-4be5-82d0-3748e633bdd3 tempest-TestInstancesWithCinderVolumes-200175985 None] Deleting attachment b34bacd2-014e-44f5-994b-737f2ff5396c. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:00:04 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841" returned: 0 in 0.423s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:04 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6eb470-a87f-45f8-a6c0-7ef480f19d79]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:04 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 Nov 04 19:00:04 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:05 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841" returned: 0 in 0.475s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.bad38648-69b4-4ca0-9b7b-95ebce7f20ddebwv0brc.img {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:05 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.bad38648-69b4-4ca0-9b7b-95ebce7f20ddebwv0brc.img Nov 04 19:00:05 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-72c74f56-3438-46f4-ba36-923bb7c3dc89" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-72c74f56-3438-46f4-ba36-923bb7c3dc89" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8a1a15-5fb3-4124-b541-912512171daa]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "cinder-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "cinder-quobyte-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:05 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 Nov 04 19:00:05 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-quobyte-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[255231b1-b674-424e-829a-3d8bf8743dd8]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:05 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba Nov 04 19:00:05 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:06 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89" returned: 0 in 0.578s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:06 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89 Nov 04 19:00:06 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:06 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba" returned: 0 in 0.783s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:06 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba Nov 04 19:00:06 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:06 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-72c74f56-3438-46f4-ba36-923bb7c3dc89" returned: 0 in 0.511s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-72c74f56-3438-46f4-ba36-923bb7c3dc89" released by "delete_volume" :: held 1.241s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-ffaddc55-e93c-4f42-9368-cef9a44d6567" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-ffaddc55-e93c-4f42-9368-cef9a44d6567" acquired by "delete_volume" :: waited 0.045s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:06 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[168f64e5-5c6c-4323-ae3a-da7aafd1c918]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:07 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba" returned: 0 in 0.705s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:07 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 Nov 04 19:00:07 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-quobyte-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba" released by "delete_volume" :: held 1.568s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:07 devstack cinder-volume[87364]: WARNING cinder.quota [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1651086910-1125020012 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1651086910-1125020012, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:07 devstack cinder-volume[87364]: WARNING cinder.quota [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1651086910-1125020012 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1651086910-1125020012, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:07 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Created reservations ['3057893c-5aa1-4d91-9683-a42eb775c1ed', '96141588-5fee-4bc5-aceb-b1ed3e24bb54', 'f4b79404-eb61-4781-adb6-77ddac37d5df', '3748a9eb-4a9c-4e89-843e-9163c9a726f5'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:07 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:00:07 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:07 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567" returned: 0 in 1.124s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:08 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567 Nov 04 19:00:08 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:08 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.932s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:08 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:08 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Deleted volume successfully. Nov 04 19:00:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f599a4e-b9b5-459d-a278-268f49fc5126 tempest-TestInstancesWithCinderVolumes-200175985 None] Lock "cinder-e588e8b0-b53a-4908-b221-7ccc5ce8f4ba-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:08 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffaddc55-e93c-4f42-9368-cef9a44d6567" returned: 0 in 1.002s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-ffaddc55-e93c-4f42-9368-cef9a44d6567" released by "delete_volume" :: held 2.350s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:09 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Created reservations ['a95f8663-d633-494c-9687-1856c3952f41'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:09 devstack cinder-volume[87364]: WARNING cinder.quota [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1200468157 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1200468157, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:09 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Created reservations ['61c886f8-1385-4e50-a8a9-cf3c86958e6a', 'a9e84abe-0f3b-4d51-8931-7d8a7f564a47', '5551db48-fbee-4c6e-a3f2-20361185e3e0', '22fddbf6-565e-48f0-bb08-81b081ce9ddf'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:09 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Created reservations ['ac5a0f1d-3b08-4fff-8c73-4ec261cdc12b', 'f9194eeb-fc0a-4e2d-a685-02166ff10df6', 'aa2ab4e1-ce58-4dc9-a32f-474f879d8dc4', 'ba0cdfba-accc-4a73-a171-7faa08c09211'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:10 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:00:10 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:10 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.323s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:10 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:10 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-087a284a-3e22-4068-8ae6-f317dab47d6c tempest-GroupSnapshotsTest-592221108 None] Delete group completed successfully. Nov 04 19:00:12 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-60eb6abb-ed36-44c6-9fb7-7be12f2a532c tempest-GroupSnapshotsTest-592221108 None] Group tempest-GroupSnapshotsTest-Group-1402702308: creating Nov 04 19:00:12 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-60eb6abb-ed36-44c6-9fb7-7be12f2a532c tempest-GroupSnapshotsTest-592221108 None] Group tempest-GroupSnapshotsTest-Group-1402702308: created successfully Nov 04 19:00:12 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-60eb6abb-ed36-44c6-9fb7-7be12f2a532c tempest-GroupSnapshotsTest-592221108 None] Create group completed successfully. Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Flow 'volume_create_manager' (cc12face-e76d-4f51-a974-d8a77ae8a998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f66e38-f385-45c5-b704-110d493a5e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f66e38-f385-45c5-b704-110d493a5e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-984142463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9a10cb-0cc5-448b-80dc-7549af8902c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3bd7137b5d4940aa9d3656b3f8af08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:13Z,use_quota=True,user_id='45bcb58dfef744499f0089459a8b471c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0ecaaf-b130-46d0-871b-eaa106729efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0ecaaf-b130-46d0-871b-eaa106729efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad41d39-f06c-4f04-89d2-32ba24e59ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad41d39-f06c-4f04-89d2-32ba24e59ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f9a10cb-0cc5-448b-80dc-7549af8902c9', 'volume_name': 'volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ded152-dd3e-4bdc-8e68-bbb1c8de2b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ded152-dd3e-4bdc-8e68-bbb1c8de2b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186ba053-0c1b-4584-ac98-c1395dd584aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:13 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Volume 8f9a10cb-0cc5-448b-80dc-7549af8902c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9', 'volume_size': 1} Nov 04 19:00:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:14 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.bad38648-69b4-4ca0-9b7b-95ebce7f20ddebwv0brc.img" returned: 0 in 9.089s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a711c87-123b-45e1-bf3d-08410b67811b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:14 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 Nov 04 19:00:14 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Flow 'volume_create_manager' (6967969f-31ba-40cb-94c3-58002494a188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f628a19-e81b-4e3b-aaa8-a3d59ae5ef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f628a19-e81b-4e3b-aaa8-a3d59ae5ef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1714321911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aeffa73e-4c0d-4eec-9425-84cd62e44141,host='devstack@QuobyteHD#QuobyteHD',id=e8bedc47-fbe5-4a6c-9f6b-d01110307676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe04aa6fa6c4db0aa632c86b00a4f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:15Z,use_quota=True,user_id='19d76e1f727b44318e8ccd15e1c4e72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97e6f6f-b5af-4460-bf01-631529655b35),volume_type_id=c97e6f6f-b5af-4460-bf01-631529655b35)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662f41d1-7ebb-42ef-a11c-3c3ed6926161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662f41d1-7ebb-42ef-a11c-3c3ed6926161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4776bf-52c1-4dce-8e44-cb5c8a3985be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4776bf-52c1-4dce-8e44-cb5c8a3985be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8bedc47-fbe5-4a6c-9f6b-d01110307676', 'volume_name': 'volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78deb07-a328-47e7-95f4-7e109dbf4ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78deb07-a328-47e7-95f4-7e109dbf4ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ff21d2-8a79-4c93-b144-a3da7eb5f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:14 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Volume e8bedc47-fbe5-4a6c-9f6b-d01110307676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676', 'volume_size': 1} Nov 04 19:00:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:15 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841" returned: 0 in 0.648s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:15 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841, size 1024.00 MB, duration 9.09 sec, destination /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.bad38648-69b4-4ca0-9b7b-95ebce7f20ddebwv0brc.img {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:00:15 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] Converted 1024.00 MB image at 112.65 MB/s Nov 04 19:00:15 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] bad38648-69b4-4ca0-9b7b-95ebce7f20dd was raw, no need to convert to raw {{(pid=87364) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:16 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:00:16 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:16 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.364s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:00:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:00:25 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=111,cinder:SELECT=123,cinder:DELETE=3,cinder:INSERT=20 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:00:25 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=139,cinder:INSERT=33,cinder:UPDATE=119,cinder:DELETE=3 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Flow 'volume_create_manager' (fc6ab33f-3188-4a77-8086-d9cca782ce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00798835-b646-4580-b6e1-845b823423b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00798835-b646-4580-b6e1-845b823423b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571f31e1-5be9-41aa-a7c5-93360f105b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19406f8d2cb646f4916aeaad8692ae6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:31Z,use_quota=True,user_id='4159cf2a487941b88b3d74755e6dfacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c29e8a8-53af-4b74-b6a6-67f8848e5c9b),volume_type_id=9c29e8a8-53af-4b74-b6a6-67f8848e5c9b)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773fba00-4df6-4f82-824f-1a38919dae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773fba00-4df6-4f82-824f-1a38919dae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d085a771-a8e0-47e3-8455-0bf014062e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.image.glance [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Creating Keystone auth plugin from conf {{(pid=87364) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d085a771-a8e0-47e3-8455-0bf014062e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '571f31e1-5be9-41aa-a7c5-93360f105b56', 'volume_name': 'volume-571f31e1-5be9-41aa-a7c5-93360f105b56', 'volume_size': 1, 'image_id': '5b39ae07-677b-4dd9-b6be-687635521f8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b39ae07-677b-4dd9-b6be-687635521f8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f14cd18fc92f87444933f717a052905', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19406f8d2cb646f4916aeaad8692ae6a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b5c457bbd8aad2dc72ca497432d362d9c89990241645128fd6d3b049250948192748aac1eccb8b26196eb05d4678a0ed0f14bca292b17ab9c8f2ab31a015a82', 'id': '5b39ae07-677b-4dd9-b6be-687635521f8c', 'created_at': datetime.datetime(2026, 11, 4, 18, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b39ae07-677b-4dd9-b6be-687635521f8c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8b9e75-b355-4e7e-9577-071d6023c8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8b9e75-b355-4e7e-9577-071d6023c8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f47665-87a2-4c96-b1bf-dd011a2c4844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:31 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Volume 571f31e1-5be9-41aa-a7c5-93360f105b56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-571f31e1-5be9-41aa-a7c5-93360f105b56', 'volume_size': 1, 'image_id': '5b39ae07-677b-4dd9-b6be-687635521f8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b39ae07-677b-4dd9-b6be-687635521f8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f14cd18fc92f87444933f717a052905', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19406f8d2cb646f4916aeaad8692ae6a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b5c457bbd8aad2dc72ca497432d362d9c89990241645128fd6d3b049250948192748aac1eccb8b26196eb05d4678a0ed0f14bca292b17ab9c8f2ab31a015a82', 'id': '5b39ae07-677b-4dd9-b6be-687635521f8c', 'created_at': datetime.datetime(2026, 11, 4, 18, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b39ae07-677b-4dd9-b6be-687635521f8c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Trying to clone 571f31e1-5be9-41aa-a7c5-93360f105b56 from image 5b39ae07-677b-4dd9-b6be-687635521f8c at location (None, [{'url': 'file:///opt/stack/data/glance/images/5b39ae07-677b-4dd9-b6be-687635521f8c', 'metadata': {}}]). {{(pid=87364) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:00:31 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd0ea72-fe16-4179-9a5d-968203279c92]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:31 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD Nov 04 19:00:31 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:32 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:32 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD Nov 04 19:00:32 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:32 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD" returned: 1 in 0.484s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:00:32 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Temporary image 5b39ae07-677b-4dd9-b6be-687635521f8c is fetched for user 4159cf2a487941b88b3d74755e6dfacc. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:00:32 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc8974f-76e0-4ba0-801a-f3eb6eda9b8f]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:32 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD Nov 04 19:00:32 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:33 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:33 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD Nov 04 19:00:33 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:33 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:00:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.879s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] Uploaded volume to glance image-id: bad38648-69b4-4ca0-9b7b-95ebce7f20dd. {{(pid=87364) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.943s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-984142463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9a10cb-0cc5-448b-80dc-7549af8902c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3bd7137b5d4940aa9d3656b3f8af08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:13Z,use_quota=True,user_id='45bcb58dfef744499f0089459a8b471c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Creating volume 8f9a10cb-0cc5-448b-80dc-7549af8902c9 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:36 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:36 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9 1073741824 Nov 04 19:00:36 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5f44fc1c-5084-49c5-a6f1-0802945edc95 tempest-VolumesActionsTest-795650821 None] Copy volume to image completed successfully. Nov 04 19:00:36 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9 1073741824" returned: 0 in 0.486s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:36 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9 Nov 04 19:00:36 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:36 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9" returned: 0 in 0.265s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.225s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aeffa73e-4c0d-4eec-9425-84cd62e44141,created_at=2026-11-04T18:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1714321911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aeffa73e-4c0d-4eec-9425-84cd62e44141,host='devstack@QuobyteHD#QuobyteHD',id=e8bedc47-fbe5-4a6c-9f6b-d01110307676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe04aa6fa6c4db0aa632c86b00a4f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:15Z,use_quota=True,user_id='19d76e1f727b44318e8ccd15e1c4e72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97e6f6f-b5af-4460-bf01-631529655b35),volume_type_id=c97e6f6f-b5af-4460-bf01-631529655b35)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Creating volume e8bedc47-fbe5-4a6c-9f6b-d01110307676 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:37 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186ba053-0c1b-4584-ac98-c1395dd584aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eebd745-54f2-4762-bd0b-8122df78cd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:37 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 1073741824 Nov 04 19:00:37 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:37 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Volume volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9 (8f9a10cb-0cc5-448b-80dc-7549af8902c9): created successfully Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eebd745-54f2-4762-bd0b-8122df78cd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Flow 'volume_create_manager' (cc12face-e76d-4f51-a974-d8a77ae8a998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7bfb6897-e2d9-4d0a-b927-1f610acb75bc tempest-AttachVolumeNegativeTest-946051108 None] Created volume successfully. Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:37 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 1073741824" returned: 0 in 0.469s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:37 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 Nov 04 19:00:37 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:37 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.206s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571f31e1-5be9-41aa-a7c5-93360f105b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19406f8d2cb646f4916aeaad8692ae6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:31Z,use_quota=True,user_id='4159cf2a487941b88b3d74755e6dfacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c29e8a8-53af-4b74-b6a6-67f8848e5c9b),volume_type_id=9c29e8a8-53af-4b74-b6a6-67f8848e5c9b)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Creating volume 571f31e1-5be9-41aa-a7c5-93360f105b56 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:37 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ff21d2-8a79-4c93-b144-a3da7eb5f805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:37 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 1073741824 Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b93ca4-266d-4ce2-95f0-abdf14e8d35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:37 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:37 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Volume volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 (e8bedc47-fbe5-4a6c-9f6b-d01110307676): created successfully Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b93ca4-266d-4ce2-95f0-abdf14e8d35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Flow 'volume_create_manager' (6967969f-31ba-40cb-94c3-58002494a188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-26af0380-324d-492b-8e2b-4580ffc0d160 tempest-GroupSnapshotsTest-592221108 None] Created volume successfully. Nov 04 19:00:38 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 1073741824" returned: 0 in 0.484s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:38 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 Nov 04 19:00:38 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:38 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56" returned: 0 in 0.360s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.373s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f12bc6-7b22-4a82-bb04-e0854fd8a894]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:38 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] GroupSnapshot b4e7beeb-f409-4b59-b385-adf8dbc27315: creating. Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Attempting download of 5b39ae07-677b-4dd9-b6be-687635521f8c ((None, [{'url': 'file:///opt/stack/data/glance/images/5b39ae07-677b-4dd9-b6be-687635521f8c', 'metadata': {}}])) to volume 571f31e1-5be9-41aa-a7c5-93360f105b56. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] Group snapshot b4e7beeb-f409-4b59-b385-adf8dbc27315: creating. {{(pid=87364) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[908c1915-7307-4105-a70d-9dd3d397b603]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b39ae07-677b-4dd9-b6be-687635521f8c_bpf47dx3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:38 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 Nov 04 19:00:38 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:38 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b39ae07-677b-4dd9-b6be-687635521f8c_bpf47dx3 Nov 04 19:00:38 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-01f8581e-2552-42be-9194-d50b84f626be req-355915a0-31a7-4da0-be51-330eb4db0475 tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:39 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b39ae07-677b-4dd9-b6be-687635521f8c_bpf47dx3" returned: 0 in 0.381s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b39ae07-677b-4dd9-b6be-687635521f8c_bpf47dx3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:39 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841" returned: 0 in 0.517s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec52f0c6-fb82-4a02-8544-02c063141b2a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:39 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b39ae07-677b-4dd9-b6be-687635521f8c_bpf47dx3 Nov 04 19:00:39 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:39 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 Nov 04 19:00:39 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:39 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b39ae07-677b-4dd9-b6be-687635521f8c_bpf47dx3" returned: 1 in 0.348s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b39ae07-677b-4dd9-b6be-687635521f8c_bpf47dx3' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba04a5ff-637c-4f89-8ef9-af0679dd6c79]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:39 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD Nov 04 19:00:39 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:39 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841" returned: 0 in 0.472s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:39 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img Nov 04 19:00:39 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:39 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:40 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD Nov 04 19:00:40 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:40 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD" returned: 1 in 0.456s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:00:40 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] 5b39ae07-677b-4dd9-b6be-687635521f8c was raw, converting to qcow2 {{(pid=87364) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:00:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:40 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 Nov 04 19:00:40 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:41 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56" returned: 0 in 1.054s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:41 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5b39ae07-677b-4dd9-b6be-687635521f8c_7zartw_idevstack@QuobyteHD, size 0.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:00:41 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:00:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:41 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 1G Nov 04 19:00:41 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:42 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 1G" returned: 0 in 0.747s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:42 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Downloaded image 5b39ae07-677b-4dd9-b6be-687635521f8c ((None, [{'url': 'file:///opt/stack/data/glance/images/5b39ae07-677b-4dd9-b6be-687635521f8c', 'metadata': {}}])) to volume 571f31e1-5be9-41aa-a7c5-93360f105b56 successfully. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:00:42 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Temporary image 5b39ae07-677b-4dd9-b6be-687635521f8c for user 4159cf2a487941b88b3d74755e6dfacc is deleted. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:00:42 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Marking volume 571f31e1-5be9-41aa-a7c5-93360f105b56 as bootable. {{(pid=87364) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:00:42 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Copying metadata from image 5b39ae07-677b-4dd9-b6be-687635521f8c to 571f31e1-5be9-41aa-a7c5-93360f105b56. {{(pid=87364) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:00:42 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Creating volume glance metadata for volume 571f31e1-5be9-41aa-a7c5-93360f105b56 backed by image 5b39ae07-677b-4dd9-b6be-687635521f8c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5b39ae07-677b-4dd9-b6be-687635521f8c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3f14cd18fc92f87444933f717a052905', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87364) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:00:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f47665-87a2-4c96-b1bf-dd011a2c4844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571f31e1-5be9-41aa-a7c5-93360f105b56', 'volume_size': 1, 'image_id': '5b39ae07-677b-4dd9-b6be-687635521f8c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b39ae07-677b-4dd9-b6be-687635521f8c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f14cd18fc92f87444933f717a052905', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19406f8d2cb646f4916aeaad8692ae6a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b5c457bbd8aad2dc72ca497432d362d9c89990241645128fd6d3b049250948192748aac1eccb8b26196eb05d4678a0ed0f14bca292b17ab9c8f2ab31a015a82', 'id': '5b39ae07-677b-4dd9-b6be-687635521f8c', 'created_at': datetime.datetime(2026, 11, 4, 18, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 0, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b39ae07-677b-4dd9-b6be-687635521f8c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bfe430-bda0-4665-a3e0-49b95d85af16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:42 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Volume volume-571f31e1-5be9-41aa-a7c5-93360f105b56 (571f31e1-5be9-41aa-a7c5-93360f105b56): created successfully Nov 04 19:00:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bfe430-bda0-4665-a3e0-49b95d85af16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Flow 'volume_create_manager' (fc6ab33f-3188-4a77-8086-d9cca782ce14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1d5bb062-56a4-4082-ab95-9af7443fe70c tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Created volume successfully. Nov 04 19:00:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Acquiring lock "cinder-571f31e1-5be9-41aa-a7c5-93360f105b56-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Lock "cinder-571f31e1-5be9-41aa-a7c5-93360f105b56-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Acquiring lock "cinder-quobyte-571f31e1-5be9-41aa-a7c5-93360f105b56" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Lock "cinder-quobyte-571f31e1-5be9-41aa-a7c5-93360f105b56" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:43 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadd5532-a1ae-408d-bbdd-94382b9f8c01]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:43 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 Nov 04 19:00:43 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:44 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56" returned: 0 in 0.676s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:44 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56 Nov 04 19:00:44 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:44 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-571f31e1-5be9-41aa-a7c5-93360f105b56" returned: 0 in 0.427s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Lock "cinder-quobyte-571f31e1-5be9-41aa-a7c5-93360f105b56" released by "delete_volume" :: held 1.192s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:44 devstack cinder-volume[87364]: WARNING cinder.quota [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:44 devstack cinder-volume[87364]: WARNING cinder.quota [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:44 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Created reservations ['f0c651dd-9b25-4817-8217-d53320deceba', 'ee053422-c529-436e-b0cd-3a657bcf60bd', '31b97dee-b676-4789-a1f9-72a5efd58630', 'efb180a6-6ec3-4033-95cd-a0dcafae9525'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:45 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:00:45 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:45 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.345s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:45 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Deleted volume successfully. Nov 04 19:00:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bdd01de3-823e-40f1-894f-02e07f062df9 tempest-VolumeAndVolumeTypeFromImageTest-1870873579 None] Lock "cinder-571f31e1-5be9-41aa-a7c5-93360f105b56-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:47 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img" returned: 0 in 7.359s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:47 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f099ec-ca14-4bb2-9ca8-611146f5a91c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:47 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 Nov 04 19:00:47 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:47 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841" returned: 0 in 0.631s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:47 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:00:47 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Converted 1024.00 MB image at 139.12 MB/s Nov 04 19:00:47 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] 163263a2-1de3-4ad6-bcd8-8e7897f12a62 was raw, converting to qcow2 {{(pid=87364) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 04 19:00:47 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dc9588-6297-4ffa-92a9-b27a229c1067]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:47 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img Nov 04 19:00:47 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:48 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img" returned: 0 in 0.343s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:48 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img Nov 04 19:00:48 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:48 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img" returned: 1 in 0.369s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:00:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img /opt/stack/data/cinder/conversion/vol_upload_glel2e21 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:48 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img /opt/stack/data/cinder/conversion/vol_upload_glel2e21 Nov 04 19:00:48 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:48 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img /opt/stack/data/cinder/conversion/vol_upload_glel2e21" returned: 0 in 0.328s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:48 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Image conversion details: src /opt/stack/data/cinder/conversion/917d2129-ff82-4f63-97df-3cffd774a841.temp_image.163263a2-1de3-4ad6-bcd8-8e7897f12a622qqflf7g.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_glel2e21 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:00:48 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 04 19:00:48 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9902c466-bd56-4229-be9f-1cfa482afdb1]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_glel2e21 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:48 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_glel2e21 Nov 04 19:00:48 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:49 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_glel2e21" returned: 0 in 0.347s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.233s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Uploaded volume to glance image-id: 163263a2-1de3-4ad6-bcd8-8e7897f12a62. {{(pid=87364) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 19:00:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.119s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] Creating offline snapshot 85cca27c-f5b6-467b-b1b3-fbeb8de62367 of volume e8bedc47-fbe5-4a6c-9f6b-d01110307676 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:00:51 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6f983d5c-6b7b-4f31-a8a2-4d2f5c76620d tempest-VolumesActionsTest-795650821 None] Copy volume to image completed successfully. Nov 04 19:00:51 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[24caf65c-d41f-4e5e-8495-38c9f153c52f]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:51 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 Nov 04 19:00:51 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:51 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676" returned: 0 in 0.442s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:51 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 1G Nov 04 19:00:51 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Acquiring lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:51 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:52 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (30715a27-53b1-4c0b-97de-d9c5068d13e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f261b317-5d00-44e9-bc89-9fd22b7d849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 1G" returned: 0 in 0.555s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:52 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 Nov 04 19:00:52 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f261b317-5d00-44e9-bc89-9fd22b7d849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-642143318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7872a8-887a-4b0b-bb2d-cddeb191d025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:52Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d537535b-63d9-4bc9-be93-5f05558f2f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d537535b-63d9-4bc9-be93-5f05558f2f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1082d216-90be-4b8f-b0e7-a1ee011429cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1082d216-90be-4b8f-b0e7-a1ee011429cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7872a8-887a-4b0b-bb2d-cddeb191d025', 'volume_name': 'volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcbdb86-dd85-48c6-9d58-7e0dc6c3d841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcbdb86-dd85-48c6-9d58-7e0dc6c3d841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa22a75-98ab-473e-a479-8de68a58f67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:52 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume 8b7872a8-887a-4b0b-bb2d-cddeb191d025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025', 'volume_size': 1} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Acquiring lock "cinder-quobyte-917d2129-ff82-4f63-97df-3cffd774a841" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Lock "cinder-quobyte-917d2129-ff82-4f63-97df-3cffd774a841" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8578b03f-ed78-48ae-9439-6f3482e2c299]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:52 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 Nov 04 19:00:52 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:52 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367" returned: 0 in 0.327s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:52 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:52 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 Nov 04 19:00:52 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:52 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841" returned: 0 in 0.382s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:52 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841 Nov 04 19:00:52 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:52 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367" returned: 0 in 0.270s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:52 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.info Nov 04 19:00:52 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:52 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-917d2129-ff82-4f63-97df-3cffd774a841" returned: 0 in 0.263s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Lock "cinder-quobyte-917d2129-ff82-4f63-97df-3cffd774a841" released by "delete_volume" :: held 0.686s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Created reservations ['bffda46b-50c6-4a1c-a1b0-4fd65063d685', '6bf814da-c87a-4405-84e4-d30a58f4d029', 'e35b1bbc-5281-455d-9563-40115890cdea', '299e9039-cce4-4c5a-86af-b2044059f1ae'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:52 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.info" returned: 0 in 0.296s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:52 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:52 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.info Nov 04 19:00:52 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:53 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:00:53 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:53 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.info" returned: 0 in 0.296s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-01f8581e-2552-42be-9194-d50b84f626be req-355915a0-31a7-4da0-be51-330eb4db0475 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.101s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-01f8581e-2552-42be-9194-d50b84f626be req-355915a0-31a7-4da0-be51-330eb4db0475 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.168s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-642143318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7872a8-887a-4b0b-bb2d-cddeb191d025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:52Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Creating volume 8b7872a8-887a-4b0b-bb2d-cddeb191d025 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:53 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:53 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.331s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:00:53 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025 1073741824 Nov 04 19:00:53 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:53 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Deleted volume successfully. Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-01f8581e-2552-42be-9194-d50b84f626be req-355915a0-31a7-4da0-be51-330eb4db0475 tempest-AttachVolumeNegativeTest-946051108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '707ab254-33cc-4765-bfb5-8237fa22e37e', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8eba2fb9-df69-4628-88e2-5d00370ff77e tempest-VolumesActionsTest-795650821 None] Lock "cinder-917d2129-ff82-4f63-97df-3cffd774a841-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:53 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ac8bbea5-7f5f-44fc-9000-c85eea20d7c6 tempest-GroupSnapshotsTest-592221108 None] group_snapshot b4e7beeb-f409-4b59-b385-adf8dbc27315: created successfully Nov 04 19:00:53 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-01f8581e-2552-42be-9194-d50b84f626be req-355915a0-31a7-4da0-be51-330eb4db0475 tempest-AttachVolumeNegativeTest-946051108 None] attachment_update completed successfully. Nov 04 19:00:53 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025 1073741824" returned: 0 in 0.624s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:54 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025 Nov 04 19:00:54 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:54 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025" returned: 0 in 0.434s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa22a75-98ab-473e-a479-8de68a58f67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f1d52f-a66b-4996-861d-a68d17256cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:54 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025 (8b7872a8-887a-4b0b-bb2d-cddeb191d025): created successfully Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f1d52f-a66b-4996-861d-a68d17256cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (30715a27-53b1-4c0b-97de-d9c5068d13e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7fdf38c9-2907-485a-a1af-7fd28adc5bc6 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created volume successfully. Nov 04 19:00:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] group_snapshot b4e7beeb-f409-4b59-b385-adf8dbc27315: deleting Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] group_snapshot b4e7beeb-f409-4b59-b385-adf8dbc27315: deleting {{(pid=87364) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-e8bedc47-fbe5-4a6c-9f6b-d01110307676" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-e8bedc47-fbe5-4a6c-9f6b-d01110307676" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-85cca27c-f5b6-467b-b1b3-fbeb8de62367" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-85cca27c-f5b6-467b-b1b3-fbeb8de62367" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Deleting offline snapshot 85cca27c-f5b6-467b-b1b3-fbeb8de62367 of volume e8bedc47-fbe5-4a6c-9f6b-d01110307676 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] snapshot_file for this snap is: volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[592830c1-c47e-43c7-b5e6-6619714ef5f2]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:54 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 Nov 04 19:00:54 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:55 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367" returned: 0 in 0.441s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[61affba6-cd3b-45a3-ba14-70b4b93c6bf8]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:55 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 Nov 04 19:00:55 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:55 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676" returned: 0 in 0.613s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:55 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 Nov 04 19:00:55 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (f7875ff7-629c-4858-8a84-d1e72ac08b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e4ad7c-ef23-4d9c-ab04-d7277c3f5693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e4ad7c-ef23-4d9c-ab04-d7277c3f5693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-264362293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796aa04f-906d-4a7d-8412-942f6a65550d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:56Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3ea271-10ee-4161-85bb-58adb73a5a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab3ea271-10ee-4161-85bb-58adb73a5a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7349eb-c33f-46ce-be25-bf8bbd421407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7349eb-c33f-46ce-be25-bf8bbd421407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '796aa04f-906d-4a7d-8412-942f6a65550d', 'volume_name': 'volume-796aa04f-906d-4a7d-8412-942f6a65550d', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5c18d1-1cc3-4a63-8971-aa8b1e74ed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5c18d1-1cc3-4a63-8971-aa8b1e74ed10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db45aa3f-9c01-4587-b8fe-b00b3260d234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:55 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume 796aa04f-906d-4a7d-8412-942f6a65550d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-796aa04f-906d-4a7d-8412-942f6a65550d', 'volume_size': 1} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-264362293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796aa04f-906d-4a7d-8412-942f6a65550d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:56Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Creating volume 796aa04f-906d-4a7d-8412-942f6a65550d {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:56 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:56 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d 1073741824 Nov 04 19:00:56 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (9a4cd891-098d-4b53-aafa-a578a9bbe343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa679ef1-e9ea-488b-b910-6a8aaecbf537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa679ef1-e9ea-488b-b910-6a8aaecbf537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-867565454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9406a954-9268-4429-bf45-ae49551b2a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:56Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f212b8e-c9c5-4e5e-90ef-35e75d6fcadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f212b8e-c9c5-4e5e-90ef-35e75d6fcadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a78b8c-0384-43c3-8356-595c170ea62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a78b8c-0384-43c3-8356-595c170ea62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9406a954-9268-4429-bf45-ae49551b2a70', 'volume_name': 'volume-9406a954-9268-4429-bf45-ae49551b2a70', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c14144-332b-4f9a-b767-14619420b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c14144-332b-4f9a-b767-14619420b884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:56 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd4c4bd-03e7-4e15-8a59-d048cd024f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:56 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume 9406a954-9268-4429-bf45-ae49551b2a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9406a954-9268-4429-bf45-ae49551b2a70', 'volume_size': 1} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367" returned: 0 in 0.798s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:56 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367 Nov 04 19:00:56 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:56 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d 1073741824" returned: 0 in 0.782s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:56 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d Nov 04 19:00:56 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:56 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-ba7745b3-c400-4a17-989b-1cb586d3521d req-db77ade7-9bd5-4e75-a5c4-2f60d2709ec2 tempest-AttachVolumeNegativeTest-946051108 None] Terminate volume connection completed successfully. Nov 04 19:00:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-ba7745b3-c400-4a17-989b-1cb586d3521d req-db77ade7-9bd5-4e75-a5c4-2f60d2709ec2 tempest-AttachVolumeNegativeTest-946051108 None] Deleting attachment 707ab254-33cc-4765-bfb5-8237fa22e37e. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:00:57 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676.85cca27c-f5b6-467b-b1b3-fbeb8de62367" returned: 0 in 0.449s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-85cca27c-f5b6-467b-b1b3-fbeb8de62367" released by "_delete_snapshot" :: held 2.470s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-e8bedc47-fbe5-4a6c-9f6b-d01110307676" released by "delete_snapshot" :: held 2.508s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:57 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (84d569ef-7137-41a7-9e15-d398c2555873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076513e5-891d-4168-aa7d-0a093ab76fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d" returned: 0 in 0.465s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.720s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-867565454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9406a954-9268-4429-bf45-ae49551b2a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:56Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Creating volume 9406a954-9268-4429-bf45-ae49551b2a70 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:57 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076513e5-891d-4168-aa7d-0a093ab76fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1784266765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a01298-c223-4bf0-b908-c1a9599b80a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:57Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:57 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70 1073741824 Nov 04 19:00:57 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae878448-d1cd-46cf-9362-854b99d5ea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae878448-d1cd-46cf-9362-854b99d5ea1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e49841-7b9a-49f2-9100-6a8f543031d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e49841-7b9a-49f2-9100-6a8f543031d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91a01298-c223-4bf0-b908-c1a9599b80a5', 'volume_name': 'volume-91a01298-c223-4bf0-b908-c1a9599b80a5', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8060ea31-a9f6-49d7-939c-f05b395d5c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8060ea31-a9f6-49d7-939c-f05b395d5c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b9b553-912f-4f82-92fc-7534963be1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:57 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume 91a01298-c223-4bf0-b908-c1a9599b80a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91a01298-c223-4bf0-b908-c1a9599b80a5', 'volume_size': 1} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db45aa3f-9c01-4587-b8fe-b00b3260d234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-796aa04f-906d-4a7d-8412-942f6a65550d', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a80a28e-b03b-4309-828b-5bb7b0239c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:57 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume volume-796aa04f-906d-4a7d-8412-942f6a65550d (796aa04f-906d-4a7d-8412-942f6a65550d): created successfully Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a80a28e-b03b-4309-828b-5bb7b0239c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (f7875ff7-629c-4858-8a84-d1e72ac08b30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:57 devstack cinder-volume[87364]: WARNING cinder.quota [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1454517111 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1454517111, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:57 devstack cinder-volume[87364]: WARNING cinder.quota [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1454517111 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1454517111, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:00:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1d5c2c89-03bd-4278-9a9f-e93d7ba2720f tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created volume successfully. Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] Created reservations ['18909064-e855-4f94-93a2-e822c942ef14', '62e7da9b-f1cf-4675-ab08-53b34204520a', '50e34766-78d0-42bb-9db8-c6a466682a8a', '19d5bb9c-1a37-4cdd-b431-160806d8232f'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:00:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8144076a-379c-4c01-8f2b-e1c39155d577 tempest-GroupSnapshotsTest-592221108 None] group_snapshot b4e7beeb-f409-4b59-b385-adf8dbc27315: deleted successfully Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (bfb810ab-c53b-475f-a873-1a14fc9a1181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e529c3-a9c3-4f6a-ab2c-a47fb1a5d057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e529c3-a9c3-4f6a-ab2c-a47fb1a5d057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-255033259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:58Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0f95eb-a34d-4a2e-8b43-23c4c97dcf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0f95eb-a34d-4a2e-8b43-23c4c97dcf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670997a2-27dd-4545-968f-254138578897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670997a2-27dd-4545-968f-254138578897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e', 'volume_name': 'volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c873ffa9-7278-41d0-a0ba-5b195c8a113a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c873ffa9-7278-41d0-a0ba-5b195c8a113a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de36efc-3f30-4e57-a0d6-09e9ba3adcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:57 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume 6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e', 'volume_size': 1} Nov 04 19:00:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:58 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70 1073741824" returned: 0 in 0.838s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:58 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70 Nov 04 19:00:58 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:58 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70" returned: 0 in 0.574s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1784266765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a01298-c223-4bf0-b908-c1a9599b80a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:57Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Creating volume 91a01298-c223-4bf0-b908-c1a9599b80a5 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:00:58 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:58 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:00:58 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5 1073741824 Nov 04 19:00:58 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (4da55383-ca19-42e4-afaa-bde5eb0bce89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc75595f-e6e5-41c5-b297-7e60f954b08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd4c4bd-03e7-4e15-8a59-d048cd024f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9406a954-9268-4429-bf45-ae49551b2a70', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc0b8ac-97ea-4221-82a0-dfb3b370cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc75595f-e6e5-41c5-b297-7e60f954b08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797572277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:59Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3897bd63-83b7-432a-984b-55d015eca1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3897bd63-83b7-432a-984b-55d015eca1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64d869d-940d-4660-89c6-7a03afa68d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64d869d-940d-4660-89c6-7a03afa68d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5', 'volume_name': 'volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6003499b-2285-47f8-9559-5c482e7be795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6003499b-2285-47f8-9559-5c482e7be795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e99591-b9fa-41ef-9393-248a62594ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:00:59 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume 6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5', 'volume_size': 1} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:00:59 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume volume-9406a954-9268-4429-bf45-ae49551b2a70 (9406a954-9268-4429-bf45-ae49551b2a70): created successfully Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc0b8ac-97ea-4221-82a0-dfb3b370cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (9a4cd891-098d-4b53-aafa-a578a9bbe343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "cinder-quobyte-e8bedc47-fbe5-4a6c-9f6b-d01110307676" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:00:59 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c62676f5-102c-4061-931e-d7febcfc4493 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created volume successfully. Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-e8bedc47-fbe5-4a6c-9f6b-d01110307676" acquired by "delete_volume" :: waited 0.033s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a00880-3b85-480f-8c07-d622f96f7608]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:59 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 Nov 04 19:00:59 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:59 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5 1073741824" returned: 0 in 0.751s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:59 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5 Nov 04 19:00:59 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:00:59 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676" returned: 0 in 0.639s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:00:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:00:59 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676 Nov 04 19:01:00 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:00 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5" returned: 0 in 0.334s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.140s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-255033259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:58Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Creating volume 6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:01:00 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b9b553-912f-4f82-92fc-7534963be1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a01298-c223-4bf0-b908-c1a9599b80a5', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7e2127-e3ab-423a-9166-4ca26edb909f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:00 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e 1073741824 Nov 04 19:01:00 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:00 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume volume-91a01298-c223-4bf0-b908-c1a9599b80a5 (91a01298-c223-4bf0-b908-c1a9599b80a5): created successfully Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7e2127-e3ab-423a-9166-4ca26edb909f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (84d569ef-7137-41a7-9e15-d398c2555873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:00 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0f155560-7ead-4724-be14-60729495f61a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created volume successfully. Nov 04 19:01:00 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e8bedc47-fbe5-4a6c-9f6b-d01110307676" returned: 0 in 0.665s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Lock "cinder-quobyte-e8bedc47-fbe5-4a6c-9f6b-d01110307676" released by "delete_volume" :: held 1.416s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Created reservations ['d80b8bf2-ee09-46f4-b542-2b7f0fccfa61'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:00 devstack cinder-volume[87364]: WARNING cinder.quota [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1454517111 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1454517111, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Created reservations ['52b2c2f5-5d32-4ff1-8290-d0ecdc6591f5', '76059838-1828-4474-a1f0-49b7f27eddf5', 'd47e7e59-70b4-4148-aceb-276c281812f1', '90898aa7-6190-4f2c-93ef-9036111fd847'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:00 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e 1073741824" returned: 0 in 0.787s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:00 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e Nov 04 19:01:00 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:01 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:01 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:01 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e" returned: 0 in 0.431s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.245s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:01 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797572277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='019b54dd014f4208bde93b8c6d0a74e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:00:59Z,use_quota=True,user_id='a53be2d4494c40c19807fc5e9ec3fa74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Creating volume 6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:01:01 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.414s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de36efc-3f30-4e57-a0d6-09e9ba3adcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:01 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5 1073741824 Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b338cfe8-2daa-4d55-aeae-dcafae0b80a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:01 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ff62377c-4488-4a41-b288-9dd6a0d0ce05 tempest-GroupSnapshotsTest-592221108 None] Delete group completed successfully. Nov 04 19:01:01 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e (6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e): created successfully Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b338cfe8-2daa-4d55-aeae-dcafae0b80a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (bfb810ab-c53b-475f-a873-1a14fc9a1181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4ac6fc31-7533-46b2-815a-2979e8b8d4f9 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created volume successfully. Nov 04 19:01:02 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5 1073741824" returned: 0 in 0.680s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:02 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5 Nov 04 19:01:02 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:02 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5" returned: 0 in 0.309s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:01:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e99591-b9fa-41ef-9393-248a62594ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f16094-c6dd-4ea1-b0c0-c6f38b372b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:02 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Volume volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5 (6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5): created successfully Nov 04 19:01:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f16094-c6dd-4ea1-b0c0-c6f38b372b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Flow 'volume_create_manager' (4da55383-ca19-42e4-afaa-bde5eb0bce89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5099a748-af5e-4f06-ae20-abccbbe0267c tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created volume successfully. Nov 04 19:01:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-quobyte-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5" acquired by "delete_volume" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:03 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[767c18e3-d3d4-41a4-9296-c3a7a77934c9]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:03 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5 Nov 04 19:01:03 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "cinder-8f9a10cb-0cc5-448b-80dc-7549af8902c9-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-8f9a10cb-0cc5-448b-80dc-7549af8902c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "cinder-quobyte-8f9a10cb-0cc5-448b-80dc-7549af8902c9" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-quobyte-8f9a10cb-0cc5-448b-80dc-7549af8902c9" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6547225-90b1-453c-9b15-294369d018d4]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:04 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5" returned: 0 in 0.640s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:04 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9 Nov 04 19:01:04 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:04 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5 Nov 04 19:01:04 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:04 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5" returned: 0 in 0.344s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:04 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9" returned: 0 in 0.483s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5" released by "delete_volume" :: held 1.076s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:04 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9 Nov 04 19:01:04 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:04 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created reservations ['fdd86c5b-b399-4a3a-8b65-e0b1b1936ceb', '22b5df49-df7e-4526-a890-c3e6b45775b9', '1de3e99a-cc3a-4d15-8b46-5f7a6293bed0', '9b0ae43e-16c4-45fb-87be-672bb9c404dc'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:05 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:05 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:05 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f9a10cb-0cc5-448b-80dc-7549af8902c9" returned: 0 in 0.418s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-quobyte-8f9a10cb-0cc5-448b-80dc-7549af8902c9" released by "delete_volume" :: held 1.001s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Created reservations ['2e3b1102-a36b-4924-9159-74ddc102d657', '3a4f6841-5b88-40ab-a6e7-7597f6c4c4fd', '6823d5f8-afed-467b-8fe2-17b5f4ef8d3c', '1d1ce94f-2729-4f72-945c-23afe32f4605'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Flow 'volume_create_manager' (e457fbe8-f53c-4bfb-8f51-2e991f878b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0a76ae-068a-41b4-b796-8c66ee8ec097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0a76ae-068a-41b4-b796-8c66ee8ec097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1909872293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8477750e-702d-4d4d-997c-8f3d66109114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a6f2d54dc0472b975fabb9afe23c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:05Z,use_quota=True,user_id='155e2c34bb7c44f58c3013d9bd6fc6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0c9a26-79fd-4f2d-9908-4210c702257c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:05 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0c9a26-79fd-4f2d-9908-4210c702257c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd58e97-aebd-4a11-8f94-f9bd11b55977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd58e97-aebd-4a11-8f94-f9bd11b55977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8477750e-702d-4d4d-997c-8f3d66109114', 'volume_name': 'volume-8477750e-702d-4d4d-997c-8f3d66109114', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f755e4-9f15-4ca1-b191-e75a8a7f9215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f755e4-9f15-4ca1-b191-e75a8a7f9215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fbee31-5870-4ea7-a290-aa8c353c627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:05 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Volume 8477750e-702d-4d4d-997c-8f3d66109114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8477750e-702d-4d4d-997c-8f3d66109114', 'volume_size': 1} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1909872293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8477750e-702d-4d4d-997c-8f3d66109114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a6f2d54dc0472b975fabb9afe23c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:05Z,use_quota=True,user_id='155e2c34bb7c44f58c3013d9bd6fc6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Creating volume 8477750e-702d-4d4d-997c-8f3d66109114 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:01:05 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:05 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 1073741824 Nov 04 19:01:05 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.444s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Deleted volume successfully. Nov 04 19:01:05 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:05 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d8d8e2c-3dcc-4229-ac02-2e4033cab1b1 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-6459a0d6-f6bd-43fc-b7aa-d06f0347a3e5-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:05 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.316s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Deleted volume successfully. Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-250cc945-78ce-4c0c-9ea9-cb7d6e1b9cad tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-8f9a10cb-0cc5-448b-80dc-7549af8902c9-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-quobyte-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc36322-54fe-4c24-a8e8-950d90c2e011]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:06 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 1073741824" returned: 0 in 0.644s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:06 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e Nov 04 19:01:06 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:06 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 Nov 04 19:01:06 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:06 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114" returned: 0 in 0.301s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fbee31-5870-4ea7-a290-aa8c353c627a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8477750e-702d-4d4d-997c-8f3d66109114', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd257254-80f7-43c6-8fc9-5b7bc3f488aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:06 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e" returned: 0 in 0.486s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:06 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Volume volume-8477750e-702d-4d4d-997c-8f3d66109114 (8477750e-702d-4d4d-997c-8f3d66109114): created successfully Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd257254-80f7-43c6-8fc9-5b7bc3f488aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Flow 'volume_create_manager' (e457fbe8-f53c-4bfb-8f51-2e991f878b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:06 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e Nov 04 19:01:06 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:06 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-214a7127-37b5-4032-b34f-b903c67a038c tempest-VolumesCloneTest-1372703296 None] Created volume successfully. Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "cinder-9b709736-61e6-43a8-8333-076552cf06c1-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-9b709736-61e6-43a8-8333-076552cf06c1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "cinder-quobyte-9b709736-61e6-43a8-8333-076552cf06c1" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-quobyte-9b709736-61e6-43a8-8333-076552cf06c1" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[459d1fee-bfb6-481e-9732-5fc97061e3c6]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:06 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1 Nov 04 19:01:06 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:06 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e" returned: 0 in 0.331s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e" released by "delete_volume" :: held 0.874s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:06 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created reservations ['884aeb44-105d-4ff7-be8c-87531af58d78', '838e53e7-cfa5-489a-927e-cbd1b45c4a76', '6225afad-8898-4482-9d75-204701d3c25a', '5ef40cfd-739a-4a69-ad78-0a5286887c6b'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:07 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:07 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-91a01298-c223-4bf0-b908-c1a9599b80a5-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-91a01298-c223-4bf0-b908-c1a9599b80a5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-quobyte-91a01298-c223-4bf0-b908-c1a9599b80a5" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:07 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1" returned: 0 in 0.519s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-91a01298-c223-4bf0-b908-c1a9599b80a5" acquired by "delete_volume" :: waited 0.046s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:07 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1 Nov 04 19:01:07 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a761f8eb-3930-4191-9828-19575503c560]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:07 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.335s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:07 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Deleted volume successfully. Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4912f71b-2d12-43c9-a38f-1a74e0f74662 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-6e4b0851-32a4-4f7c-b10a-d722fbbb8f1e-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:07 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5 Nov 04 19:01:07 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:07 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9b709736-61e6-43a8-8333-076552cf06c1" returned: 0 in 0.357s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-quobyte-9b709736-61e6-43a8-8333-076552cf06c1" released by "delete_volume" :: held 0.927s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Created reservations ['608c09bd-1e90-4b6d-a91b-70c39eabf415', 'd9b9c6f3-80ec-49b9-a95c-3c036745d76b', 'e9fa5df3-fdf8-40bc-9e3f-0be99b924b4e', '6c750a35-11f0-49d2-8a21-02249419e856'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:07 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5" returned: 0 in 0.549s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:07 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:07 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:07 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5 Nov 04 19:01:07 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:08 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.339s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:01:08 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Deleted volume successfully. Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Flow 'volume_create_manager' (06bab395-6eb7-4622-91e7-209de1127128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42c6385-fdc9-40af-a5f2-0b209e8b91f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f61cc512-b539-4337-b0cf-cc3b357a8e84 tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-9b709736-61e6-43a8-8333-076552cf06c1-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42c6385-fdc9-40af-a5f2-0b209e8b91f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1020154537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b111fb51-9f2f-4386-9d35-03c9a2c7f9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a6f2d54dc0472b975fabb9afe23c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8477750e-702d-4d4d-997c-8f3d66109114,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:08Z,use_quota=True,user_id='155e2c34bb7c44f58c3013d9bd6fc6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf74ce5-008d-4dd6-a59d-99504d6d79e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:08 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf74ce5-008d-4dd6-a59d-99504d6d79e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5faf89d-0441-48f8-810e-b6654c546a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-91a01298-c223-4bf0-b908-c1a9599b80a5" returned: 0 in 0.433s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5faf89d-0441-48f8-810e-b6654c546a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b111fb51-9f2f-4386-9d35-03c9a2c7f9f2', 'volume_name': 'volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2', 'volume_size': 2, 'source_volid': '8477750e-702d-4d4d-997c-8f3d66109114', 'source_volstatus': 'available'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f978a10-f8f2-4648-966c-9f04bcdf4150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f978a10-f8f2-4648-966c-9f04bcdf4150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b54c0a-6e01-4009-a793-028ddad4395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:08 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Volume b111fb51-9f2f-4386-9d35-03c9a2c7f9f2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2', 'volume_size': 2, 'source_volid': '8477750e-702d-4d4d-997c-8f3d66109114', 'source_volstatus': 'available'} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-91a01298-c223-4bf0-b908-c1a9599b80a5" released by "delete_volume" :: held 1.092s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:08 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Cloning volume 8477750e-702d-4d4d-997c-8f3d66109114 to volume b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Creating offline snapshot 184db401-e2f0-4d26-bd11-36d85b092f7e of volume 8477750e-702d-4d4d-997c-8f3d66109114 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac0e498-c142-4b04-99e7-2210f49a08d9]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created reservations ['54649a8d-47ac-4f90-a517-34fd92c25c9d', '22b43580-a014-4563-ba7c-080bd133d7eb', 'cdd33bc3-1163-414d-a314-e9594090db8f', '3bdf203c-b398-4440-9824-5ecc1b09d863'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:08 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 Nov 04 19:01:08 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:08 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:08 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:08 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.264s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:08 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Deleted volume successfully. Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b5254537-92cc-4242-8223-d1a6e8280b14 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-91a01298-c223-4bf0-b908-c1a9599b80a5-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:08 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114" returned: 0 in 0.446s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:08 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e 1G Nov 04 19:01:08 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "cinder-4f790852-1176-470c-ad71-85e58bd32352-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-4f790852-1176-470c-ad71-85e58bd32352-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "cinder-quobyte-4f790852-1176-470c-ad71-85e58bd32352" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-quobyte-4f790852-1176-470c-ad71-85e58bd32352" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e26c8e-3c06-435a-b42d-783a6e8798b6]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:09 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352 Nov 04 19:01:09 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-9406a954-9268-4429-bf45-ae49551b2a70-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:09 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e 1G" returned: 0 in 0.560s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8477750e-702d-4d4d-997c-8f3d66109114 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-9406a954-9268-4429-bf45-ae49551b2a70-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:09 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8477750e-702d-4d4d-997c-8f3d66109114 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e Nov 04 19:01:09 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-quobyte-9406a954-9268-4429-bf45-ae49551b2a70" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-9406a954-9268-4429-bf45-ae49551b2a70" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5207361-5eeb-4caf-877e-a6b83ef0d60b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:09 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352" returned: 0 in 0.551s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:09 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70 Nov 04 19:01:09 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:09 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352 Nov 04 19:01:09 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:09 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-31f1d1ff-bab6-4a3d-a1af-9c09fc2969b7 tempest-GroupSnapshotsV319Test-276052733 None] Group tempest-GroupSnapshotsV319Test-Group-1314264012: creating Nov 04 19:01:09 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8477750e-702d-4d4d-997c-8f3d66109114 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e" returned: 0 in 0.434s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:09 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e is being set with open permissions: ugo+rw Nov 04 19:01:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:09 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-31f1d1ff-bab6-4a3d-a1af-9c09fc2969b7 tempest-GroupSnapshotsV319Test-276052733 None] Group tempest-GroupSnapshotsV319Test-Group-1314264012: created successfully Nov 04 19:01:09 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-31f1d1ff-bab6-4a3d-a1af-9c09fc2969b7 tempest-GroupSnapshotsV319Test-276052733 None] Create group completed successfully. Nov 04 19:01:09 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e Nov 04 19:01:09 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:10 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4f790852-1176-470c-ad71-85e58bd32352" returned: 0 in 0.317s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-quobyte-4f790852-1176-470c-ad71-85e58bd32352" released by "delete_volume" :: held 0.923s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:10 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70" returned: 0 in 0.547s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:10 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e" returned: 0 in 0.309s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:10 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70 Nov 04 19:01:10 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Created reservations ['65e7d179-9b86-4a23-a949-1177bbbe9e70', 'fa5afeb8-739a-4349-a153-39d75400248a', 'e786a567-c40b-4a22-9511-076424bf9c57', 'b8e69f35-e90c-4f10-ab9e-b0ee2bc61fe4'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:10 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.info Nov 04 19:01:10 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:10 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:10 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:10 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-9406a954-9268-4429-bf45-ae49551b2a70" returned: 0 in 0.312s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-9406a954-9268-4429-bf45-ae49551b2a70" released by "delete_volume" :: held 0.935s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created reservations ['ea1b0a5c-1cc7-406a-a579-038e84c152dc', 'a0d51751-3a22-450b-8a69-e8d958a628bb', '1aa4e948-1c62-4d0d-9172-7d9219d56d21', '5ba5dcd2-2aa1-41dc-a716-cf696fd8af6f'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:10 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.info" returned: 0 in 0.376s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:10 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.info is being set with open permissions: ugo+rw Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:10 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.info Nov 04 19:01:10 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:10 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:10 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:10 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.323s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:10 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Deleted volume successfully. Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8608ccc5-9585-48bd-bde2-5e3db0fc1c0b tempest-AttachVolumeNegativeTest-946051108 None] Lock "cinder-4f790852-1176-470c-ad71-85e58bd32352-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:10 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.info" returned: 0 in 0.302s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:11 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Acquiring lock "cinder-quobyte-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:11 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Deleted volume successfully. Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-quobyte-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] snapshot: 184db401-e2f0-4d26-bd11-36d85b092f7e, volume: b111fb51-9f2f-4386-9d35-03c9a2c7f9f2, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7012bf75-7114-4c0a-a9e9-bfeb6da39686 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-9406a954-9268-4429-bf45-ae49551b2a70-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9e0b2f-bc8a-46d5-9975-50fb0edfa0eb]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:11 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e Nov 04 19:01:11 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:11 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e" returned: 0 in 0.395s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8477750e-702d-4d4d-997c-8f3d66109114(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33b0981-fbb5-46d1-84db-873e8fad9ec0]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:01:11 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 Nov 04 19:01:11 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Flow 'volume_create_manager' (2030040a-eaab-444e-b703-1615ffb72d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931a35ae-8ee5-4f02-b58d-73ec51ef97ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931a35ae-8ee5-4f02-b58d-73ec51ef97ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1574369240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a1db59c-d897-4a19-89df-55808ad2bf7d,host='devstack@QuobyteHD#QuobyteHD',id=207d82b6-2b91-45fb-a44f-b665e3617f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff60f84cd1e483a8a206bf8418c53de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:12Z,use_quota=True,user_id='d351b41321384829b433804b7e44f7ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64c0d3c9-b5c6-417b-b3ba-7516fac88620),volume_type_id=64c0d3c9-b5c6-417b-b3ba-7516fac88620)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d37f503-f7a5-4d09-acbc-11e6bcda6ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d37f503-f7a5-4d09-acbc-11e6bcda6ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73bebf1-2da1-4608-87f0-f713778ab96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73bebf1-2da1-4608-87f0-f713778ab96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207d82b6-2b91-45fb-a44f-b665e3617f61', 'volume_name': 'volume-207d82b6-2b91-45fb-a44f-b665e3617f61', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a38d7ab-3ac3-43ba-a9d4-51b8b3fbb189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a38d7ab-3ac3-43ba-a9d4-51b8b3fbb189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b149a5-fe82-4586-9712-f2de15e85aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:11 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Volume 207d82b6-2b91-45fb-a44f-b665e3617f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207d82b6-2b91-45fb-a44f-b665e3617f61', 'volume_size': 1} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-796aa04f-906d-4a7d-8412-942f6a65550d-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-796aa04f-906d-4a7d-8412-942f6a65550d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-quobyte-796aa04f-906d-4a7d-8412-942f6a65550d" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-796aa04f-906d-4a7d-8412-942f6a65550d" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce30fc9-442d-4770-a574-c03e7956be24]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:12 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114" returned: 0 in 0.510s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:12 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d Nov 04 19:01:12 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:12 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 Nov 04 19:01:12 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:12 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d" returned: 0 in 0.435s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:12 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d Nov 04 19:01:12 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:12 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-796aa04f-906d-4a7d-8412-942f6a65550d" returned: 0 in 0.324s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-796aa04f-906d-4a7d-8412-942f6a65550d" released by "delete_volume" :: held 0.813s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created reservations ['99fc86b5-3a11-4dc8-8519-e97c2d08d58e', 'b7663961-aa06-489c-8ee3-6864a2a907ed', '9b31cfb0-7783-479b-8497-22ff332dad84', '92f77a22-2850-4471-bff6-cbd2190666e6'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:13 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:13 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-8b7872a8-887a-4b0b-bb2d-cddeb191d025-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-8b7872a8-887a-4b0b-bb2d-cddeb191d025-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "cinder-quobyte-8b7872a8-887a-4b0b-bb2d-cddeb191d025" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-8b7872a8-887a-4b0b-bb2d-cddeb191d025" acquired by "delete_volume" :: waited 0.047s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a601fd9d-b0f5-4fe5-99a6-a5c12b6b4288]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:13 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.647s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:13 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Deleted volume successfully. Nov 04 19:01:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-80d99ba4-e5b0-4745-8030-1762e2f74fd4 tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-796aa04f-906d-4a7d-8412-942f6a65550d-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:13 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025 Nov 04 19:01:13 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:14 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025" returned: 0 in 0.828s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:14 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025 Nov 04 19:01:14 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:14 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8b7872a8-887a-4b0b-bb2d-cddeb191d025" returned: 0 in 0.499s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-quobyte-8b7872a8-887a-4b0b-bb2d-cddeb191d025" released by "delete_volume" :: held 1.447s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:15 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Created reservations ['8a729917-7be1-4b1e-8cbe-5a03d6ec0f61', '5c3749d8-1c39-4b40-8973-3254fc974752', '2f9ebb0b-601f-42e1-a3fe-59a945b83aa5', '3bc2a7df-bd4d-4b5e-962d-4dbf38d0e9f8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:15 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:15 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:15 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.469s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:15 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:15 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Deleted volume successfully. Nov 04 19:01:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5b354e1f-9cc6-4fe4-84c9-a63fa51d569a tempest-CreateVolumesFromSourceVolumeTest-1575446729 None] Lock "cinder-8b7872a8-887a-4b0b-bb2d-cddeb191d025-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:16 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:16 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:16 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.487s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:01:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:01:20 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2" returned: 0 in 8.693s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:20 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114, size 1024.00 MB, duration 8.69 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:01:20 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Converted 1024.00 MB image at 117.77 MB/s Nov 04 19:01:20 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 is being set with open permissions: ugo+rw Nov 04 19:01:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:20 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 Nov 04 19:01:20 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:20 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2" returned: 0 in 0.260s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-quobyte-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2" released by "_copy_volume_from_snapshot" :: held 9.953s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Acquiring lock "cinder-quobyte-184db401-e2f0-4d26-bd11-36d85b092f7e" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-quobyte-184db401-e2f0-4d26-bd11-36d85b092f7e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Deleting offline snapshot 184db401-e2f0-4d26-bd11-36d85b092f7e of volume 8477750e-702d-4d4d-997c-8f3d66109114 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:01:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] snapshot_file for this snap is: volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:01:21 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c08b6e-fb91-4a0e-b80c-09dac920cfac]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:21 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e Nov 04 19:01:21 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:21 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e" returned: 0 in 0.486s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8477750e-702d-4d4d-997c-8f3d66109114(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:21 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7ecfbe-ee2e-4060-bb18-a5baba37503b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:21 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 Nov 04 19:01:21 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:22 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114" returned: 0 in 0.573s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:22 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e Nov 04 19:01:22 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:22 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e" returned: 0 in 0.396s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:22 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e Nov 04 19:01:22 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:22 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114.184db401-e2f0-4d26-bd11-36d85b092f7e" returned: 0 in 0.284s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-quobyte-184db401-e2f0-4d26-bd11-36d85b092f7e" released by "_delete_snapshot" :: held 1.852s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.478s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.187s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3a1db59c-d897-4a19-89df-55808ad2bf7d,created_at=2026-11-04T18:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1574369240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a1db59c-d897-4a19-89df-55808ad2bf7d,host='devstack@QuobyteHD#QuobyteHD',id=207d82b6-2b91-45fb-a44f-b665e3617f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ff60f84cd1e483a8a206bf8418c53de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:12Z,use_quota=True,user_id='d351b41321384829b433804b7e44f7ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64c0d3c9-b5c6-417b-b3ba-7516fac88620),volume_type_id=64c0d3c9-b5c6-417b-b3ba-7516fac88620)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Creating volume 207d82b6-2b91-45fb-a44f-b665e3617f61 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:01:22 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b54c0a-6e01-4009-a793-028ddad4395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2', 'volume_size': 2, 'source_volid': '8477750e-702d-4d4d-997c-8f3d66109114', 'source_volstatus': 'available'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:22 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 1073741824 Nov 04 19:01:22 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0d6260-7408-4415-a631-3b4282a5a72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:22 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Volume volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 (b111fb51-9f2f-4386-9d35-03c9a2c7f9f2): created successfully Nov 04 19:01:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0d6260-7408-4415-a631-3b4282a5a72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Flow 'volume_create_manager' (06bab395-6eb7-4622-91e7-209de1127128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:23 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d75dce30-ea37-44bf-bb1e-0d389338b238 tempest-VolumesCloneTest-1372703296 None] Created volume successfully. Nov 04 19:01:23 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 1073741824" returned: 0 in 0.516s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:23 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 Nov 04 19:01:23 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:23 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61" returned: 0 in 0.294s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:01:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b149a5-fe82-4586-9712-f2de15e85aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207d82b6-2b91-45fb-a44f-b665e3617f61', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c49222-7a01-40ae-b0a7-58657338608f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:23 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Volume volume-207d82b6-2b91-45fb-a44f-b665e3617f61 (207d82b6-2b91-45fb-a44f-b665e3617f61): created successfully Nov 04 19:01:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c49222-7a01-40ae-b0a7-58657338608f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Flow 'volume_create_manager' (2030040a-eaab-444e-b703-1615ffb72d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:23 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-45759066-2e97-41f9-96e3-8cd2e87f38b4 tempest-GroupSnapshotsV319Test-276052733 None] Created volume successfully. Nov 04 19:01:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Acquiring lock "cinder-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Acquiring lock "cinder-quobyte-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-quobyte-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:24 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd0eec8-93af-4b26-9b83-90d7be9c2e3c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:24 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 Nov 04 19:01:24 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:24 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2" returned: 0 in 0.406s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:24 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2 Nov 04 19:01:24 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:24 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2" returned: 0 in 0.268s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-quobyte-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2" released by "delete_volume" :: held 0.726s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:24 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Created reservations ['137f181c-da59-4b41-9392-48d0d4bdd127', '0c8552c0-2f2a-4f15-be0c-e944fd23678f', '21c4b52e-f687-4401-ae65-1b2916dcc44c', '831ea241-c2e2-4e63-b048-a7804f7700b0'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:25 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:25 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:25 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] GroupSnapshot 4f22d30c-f3e3-4230-8582-c0de4ed7397d: creating. Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=120,cinder:UPDATE=141,cinder:DELETE=12,cinder:INSERT=51 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:01:25 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.319s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=172,cinder:INSERT=31,cinder:SELECT=129,cinder:DELETE=11 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:01:25 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Deleted volume successfully. Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] Group snapshot 4f22d30c-f3e3-4230-8582-c0de4ed7397d: creating. {{(pid=87364) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] Creating offline snapshot a0989d98-1c39-4054-9d15-aaeb2788448b of volume 207d82b6-2b91-45fb-a44f-b665e3617f61 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b370aeee-6119-4782-a32c-f0a1b2014ff9 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-b111fb51-9f2f-4386-9d35-03c9a2c7f9f2-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Acquiring lock "cinder-8477750e-702d-4d4d-997c-8f3d66109114-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead3a673-ba73-42fa-8b50-118519688d1a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-8477750e-702d-4d4d-997c-8f3d66109114-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Acquiring lock "cinder-quobyte-8477750e-702d-4d4d-997c-8f3d66109114" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-quobyte-8477750e-702d-4d4d-997c-8f3d66109114" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:25 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 Nov 04 19:01:25 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e977f4f-82dd-408a-9305-f9af67087ccd]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:25 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 Nov 04 19:01:25 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:25 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61" returned: 0 in 0.462s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:26 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b 1G Nov 04 19:01:26 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:26 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114" returned: 0 in 0.442s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:26 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114 Nov 04 19:01:26 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:26 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8477750e-702d-4d4d-997c-8f3d66109114" returned: 0 in 0.280s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:26 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b 1G" returned: 0 in 0.468s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-207d82b6-2b91-45fb-a44f-b665e3617f61 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-quobyte-8477750e-702d-4d4d-997c-8f3d66109114" released by "delete_volume" :: held 0.827s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:26 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-207d82b6-2b91-45fb-a44f-b665e3617f61 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b Nov 04 19:01:26 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Created reservations ['beb986e3-5473-478b-9a97-33b4a70bc58c', '2fd2ce5c-5b1a-4721-b508-8e27f1da69ac', '69195607-6b45-4d44-82ee-5a3a0551c7d7', 'cf6b7961-92de-4162-852a-dd17e8bc03ac'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:26 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:26 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:26 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-207d82b6-2b91-45fb-a44f-b665e3617f61 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b" returned: 0 in 0.391s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:26 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:26 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b Nov 04 19:01:26 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:26 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.353s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:26 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:27 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Deleted volume successfully. Nov 04 19:01:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b8a0a373-2f13-4058-a3ea-ae8869cc4031 tempest-VolumesCloneTest-1372703296 None] Lock "cinder-8477750e-702d-4d4d-997c-8f3d66109114-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:27 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b" returned: 0 in 0.348s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:27 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.info Nov 04 19:01:27 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:27 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.info" returned: 0 in 0.293s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:27 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:01:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:27 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.info Nov 04 19:01:27 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:27 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.info" returned: 0 in 0.282s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:28 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-eca5aa50-67ef-43cc-98f8-2334efc965e2 tempest-GroupSnapshotsV319Test-276052733 None] group_snapshot 4f22d30c-f3e3-4230-8582-c0de4ed7397d: created successfully Nov 04 19:01:29 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] group_snapshot 4f22d30c-f3e3-4230-8582-c0de4ed7397d: deleting Nov 04 19:01:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] group_snapshot 4f22d30c-f3e3-4230-8582-c0de4ed7397d: deleting {{(pid=87364) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 04 19:01:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Acquiring lock "cinder-quobyte-207d82b6-2b91-45fb-a44f-b665e3617f61" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Lock "cinder-quobyte-207d82b6-2b91-45fb-a44f-b665e3617f61" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Acquiring lock "cinder-quobyte-a0989d98-1c39-4054-9d15-aaeb2788448b" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Lock "cinder-quobyte-a0989d98-1c39-4054-9d15-aaeb2788448b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Deleting offline snapshot a0989d98-1c39-4054-9d15-aaeb2788448b of volume 207d82b6-2b91-45fb-a44f-b665e3617f61 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:01:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] snapshot_file for this snap is: volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:01:29 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[03392a69-3661-49ed-8d71-8137a4f1299d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:29 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b Nov 04 19:01:29 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:30 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b" returned: 0 in 0.453s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-207d82b6-2b91-45fb-a44f-b665e3617f61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:30 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b3488e-8093-4d75-bfcf-ecb4cc453360]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:30 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 Nov 04 19:01:30 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:30 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61" returned: 0 in 0.461s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:30 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b Nov 04 19:01:30 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:31 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b" returned: 0 in 0.395s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:31 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b Nov 04 19:01:31 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:31 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61.a0989d98-1c39-4054-9d15-aaeb2788448b" returned: 0 in 0.328s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Lock "cinder-quobyte-a0989d98-1c39-4054-9d15-aaeb2788448b" released by "_delete_snapshot" :: held 1.812s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Lock "cinder-quobyte-207d82b6-2b91-45fb-a44f-b665e3617f61" released by "delete_snapshot" :: held 1.845s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:31 devstack cinder-volume[87364]: WARNING cinder.quota [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1156036633 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1156036633, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:01:31 devstack cinder-volume[87364]: WARNING cinder.quota [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1156036633 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1156036633, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] Created reservations ['9758644e-27f9-4965-a674-6a8b869b5c94', '3ecce67a-c37c-4756-9b44-bcdf5bc6ae6d', '545eeb9c-1a43-475d-b5cd-89870afe75cf', '38f19217-ea42-42e0-9293-949d72762b2f'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Flow 'volume_create_manager' (f7ebc724-2bed-4a29-9bea-abaec306383f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241d4251-d374-4df7-80d5-a68c7cf68ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241d4251-d374-4df7-80d5-a68c7cf68ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-847228994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1e97c0-431c-4823-b0af-533ec1fb6a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f20c0b612fe49a6925810ab0b84b221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:32Z,use_quota=True,user_id='be054024918549d089aed9aeb381bc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb1968c-bb8f-4f0b-86dd-547307ebf1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb1968c-bb8f-4f0b-86dd-547307ebf1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32c094f-13ed-4de9-ad1b-629607d8e46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32c094f-13ed-4de9-ad1b-629607d8e46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1e97c0-431c-4823-b0af-533ec1fb6a92', 'volume_name': 'volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ab413f-2d27-4cf5-80af-9189897aed07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ab413f-2d27-4cf5-80af-9189897aed07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91e5974-29b2-4329-a92f-efb6c31569a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:31 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Volume fa1e97c0-431c-4823-b0af-533ec1fb6a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92', 'volume_size': 1} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-847228994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1e97c0-431c-4823-b0af-533ec1fb6a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f20c0b612fe49a6925810ab0b84b221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:32Z,use_quota=True,user_id='be054024918549d089aed9aeb381bc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Creating volume fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:01:31 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:01:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:31 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a320494d-cbaa-420b-b23f-30ccdaf78581 tempest-GroupSnapshotsV319Test-276052733 None] group_snapshot 4f22d30c-f3e3-4230-8582-c0de4ed7397d: deleted successfully Nov 04 19:01:31 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 1073741824 Nov 04 19:01:31 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Acquiring lock "cinder-quobyte-207d82b6-2b91-45fb-a44f-b665e3617f61" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Lock "cinder-quobyte-207d82b6-2b91-45fb-a44f-b665e3617f61" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:32 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c422c52-961f-495c-ae21-0c5d315ea976]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 1073741824" returned: 0 in 0.586s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:32 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 Nov 04 19:01:32 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:32 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 Nov 04 19:01:32 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:32 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92" returned: 0 in 0.274s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91e5974-29b2-4329-a92f-efb6c31569a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3ab4e6-b23c-49d5-9ecd-b1e2846b2aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:32 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Volume volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 (fa1e97c0-431c-4823-b0af-533ec1fb6a92): created successfully Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3ab4e6-b23c-49d5-9ecd-b1e2846b2aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Flow 'volume_create_manager' (f7ebc724-2bed-4a29-9bea-abaec306383f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:32 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8601305e-fead-4d7e-82c3-8b94a487efe7 tempest-VolumesSnapshotListTestJSON-401588524 None] Created volume successfully. Nov 04 19:01:32 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61" returned: 0 in 0.487s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:32 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61 Nov 04 19:01:32 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:33 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-207d82b6-2b91-45fb-a44f-b665e3617f61" returned: 0 in 0.290s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Lock "cinder-quobyte-207d82b6-2b91-45fb-a44f-b665e3617f61" released by "delete_volume" :: held 0.867s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Created reservations ['fb1f420f-698e-4bd4-9972-52207636cb51'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:33 devstack cinder-volume[87364]: WARNING cinder.quota [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1156036633 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1156036633, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Created reservations ['cbfd8bd2-9f8b-453d-be2e-8645b1dfb22e', '6dcb2766-97aa-4c2c-a2b6-b19e70894c6a', 'c70884cf-c882-40ea-b1aa-940919f6dc4c', '2dcbf780-14e7-472f-8f1e-1988ff10e2a1'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:33 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:33 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a6073186-7260-4cd8-a6ef-9b24af264b8d tempest-GroupsV314Test-1329055482 None] Group tempest-GroupsV314Test-Group-792888074: creating Nov 04 19:01:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a6073186-7260-4cd8-a6ef-9b24af264b8d tempest-GroupsV314Test-1329055482 None] Group tempest-GroupsV314Test-Group-792888074: created successfully Nov 04 19:01:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a6073186-7260-4cd8-a6ef-9b24af264b8d tempest-GroupsV314Test-1329055482 None] Create group completed successfully. Nov 04 19:01:33 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.394s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:33 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-01b15772-d031-4d09-b577-8808df310bcc tempest-GroupSnapshotsV319Test-276052733 None] Delete group completed successfully. Nov 04 19:01:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] Creating offline snapshot 39438965-1a59-43d8-a62c-ad51961419d7 of volume fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:01:34 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13440d1-f83f-413f-9fcf-660e55aee32b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:34 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 Nov 04 19:01:34 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:34 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92" returned: 0 in 0.425s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:34 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 1G Nov 04 19:01:34 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:35 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 1G" returned: 0 in 0.514s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:35 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 Nov 04 19:01:35 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:35 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7" returned: 0 in 0.427s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:35 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 is being set with open permissions: ugo+rw Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:35 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 Nov 04 19:01:35 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Flow 'volume_create_manager' (9290b7ae-0abf-4c17-90c1-59d6117ad8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6a0b71-048e-498a-af2b-beca91b0dde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6a0b71-048e-498a-af2b-beca91b0dde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764933147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8c08500-7807-4dc7-8dde-cc1c1898cb1e,host='devstack@QuobyteHD#QuobyteHD',id=afc8980b-3619-45e1-98df-32eb06865e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50b4caed9f20445fa71d2c3a99cdaee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:36Z,use_quota=True,user_id='a2c9d91be70548cb8d43ce81a6ef5eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bebe5a38-e4c9-4100-a749-d85b586806d7),volume_type_id=bebe5a38-e4c9-4100-a749-d85b586806d7)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee999b6-baf5-4176-b53a-05f035295930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee999b6-baf5-4176-b53a-05f035295930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c3f4c9-02fb-4e92-827a-be0de788448d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c3f4c9-02fb-4e92-827a-be0de788448d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc8980b-3619-45e1-98df-32eb06865e88', 'volume_name': 'volume-afc8980b-3619-45e1-98df-32eb06865e88', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00338f46-11fa-42ba-bfb6-08713fca1f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00338f46-11fa-42ba-bfb6-08713fca1f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472b4394-7d7e-4bf1-97bb-bbbc4c4a69dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:35 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Volume afc8980b-3619-45e1-98df-32eb06865e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc8980b-3619-45e1-98df-32eb06865e88', 'volume_size': 1} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:35 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7" returned: 0 in 0.367s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:35 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.info Nov 04 19:01:35 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:36 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.info" returned: 0 in 0.348s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:36 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.info is being set with open permissions: ugo+rw Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:36 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.info Nov 04 19:01:36 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:36 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.info" returned: 0 in 0.287s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8c08500-7807-4dc7-8dde-cc1c1898cb1e,created_at=2026-11-04T18:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764933147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8c08500-7807-4dc7-8dde-cc1c1898cb1e,host='devstack@QuobyteHD#QuobyteHD',id=afc8980b-3619-45e1-98df-32eb06865e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50b4caed9f20445fa71d2c3a99cdaee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:01:36Z,use_quota=True,user_id='a2c9d91be70548cb8d43ce81a6ef5eb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bebe5a38-e4c9-4100-a749-d85b586806d7),volume_type_id=bebe5a38-e4c9-4100-a749-d85b586806d7)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Creating volume afc8980b-3619-45e1-98df-32eb06865e88 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:01:36 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:01:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:36 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 1073741824 Nov 04 19:01:36 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9bf7d4db-3de0-432c-a988-84b0b9d1e96a tempest-VolumesSnapshotListTestJSON-401588524 None] Create snapshot completed successfully Nov 04 19:01:37 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 1073741824" returned: 0 in 0.514s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:37 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 Nov 04 19:01:37 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:37 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88" returned: 0 in 0.348s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.018s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472b4394-7d7e-4bf1-97bb-bbbc4c4a69dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc8980b-3619-45e1-98df-32eb06865e88', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d90ed4-f462-40ea-bc57-0f949ef7f1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] Creating offline snapshot cc31d557-9e5b-40e2-b6b7-7d6e92daab3b of volume fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:01:37 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Volume volume-afc8980b-3619-45e1-98df-32eb06865e88 (afc8980b-3619-45e1-98df-32eb06865e88): created successfully Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d90ed4-f462-40ea-bc57-0f949ef7f1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Flow 'volume_create_manager' (9290b7ae-0abf-4c17-90c1-59d6117ad8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e72f56-5efd-4921-852a-7b7293859269]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f74e4842-a0c8-4e30-98f4-f8f4001aa16f tempest-GroupsV314Test-1329055482 None] Created volume successfully. Nov 04 19:01:37 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 Nov 04 19:01:37 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:37 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7" returned: 0 in 0.409s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:37 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b 1G Nov 04 19:01:37 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:38 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b 1G" returned: 0 in 0.586s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:38 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b Nov 04 19:01:38 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:38 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b" returned: 0 in 0.381s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:38 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b is being set with open permissions: ugo+rw Nov 04 19:01:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:38 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b Nov 04 19:01:38 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:39 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b" returned: 0 in 0.291s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.464s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:39 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Cloning volume afc8980b-3619-45e1-98df-32eb06865e88 to volume 3bf7006d-5f0c-4681-bb75-2279ebb7fffd Nov 04 19:01:39 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0ec8be83-b525-4cd4-8562-9336d5092370 tempest-VolumesSnapshotListTestJSON-401588524 None] Create snapshot completed successfully Nov 04 19:01:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Creating offline snapshot e0f43184-484c-4650-8385-0184e4047f42 of volume afc8980b-3619-45e1-98df-32eb06865e88 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:01:39 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[630f0b53-0f2e-4fbd-9e98-b090512fdc13]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:39 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 Nov 04 19:01:39 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:39 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88" returned: 0 in 0.452s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:39 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 1G Nov 04 19:01:39 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:40 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 1G" returned: 0 in 0.446s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc8980b-3619-45e1-98df-32eb06865e88 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:40 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc8980b-3619-45e1-98df-32eb06865e88 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 Nov 04 19:01:40 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:40 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc8980b-3619-45e1-98df-32eb06865e88 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42" returned: 0 in 0.306s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:40 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:01:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:40 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 Nov 04 19:01:40 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:40 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42" returned: 0 in 0.284s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:40 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.info Nov 04 19:01:40 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:40 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-38a25153-979a-4aab-b251-a16c38d00a0b tempest-GroupsV320Test-835197749 None] Group tempest-GroupsV320Test-Group-91123913: creating Nov 04 19:01:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-38a25153-979a-4aab-b251-a16c38d00a0b tempest-GroupsV320Test-835197749 None] Group tempest-GroupsV320Test-Group-91123913: created successfully Nov 04 19:01:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-38a25153-979a-4aab-b251-a16c38d00a0b tempest-GroupsV320Test-835197749 None] Create group completed successfully. Nov 04 19:01:41 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.info" returned: 0 in 0.290s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:41 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.info is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:41 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.info Nov 04 19:01:41 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:41 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.info" returned: 0 in 0.259s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Acquiring lock "cinder-quobyte-3bf7006d-5f0c-4681-bb75-2279ebb7fffd" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Lock "cinder-quobyte-3bf7006d-5f0c-4681-bb75-2279ebb7fffd" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] snapshot: e0f43184-484c-4650-8385-0184e4047f42, volume: 3bf7006d-5f0c-4681-bb75-2279ebb7fffd, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caa31a4-6c4f-4f35-95d5-8162ec584e49]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:41 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 Nov 04 19:01:41 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:41 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42" returned: 0 in 0.358s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afc8980b-3619-45e1-98df-32eb06865e88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0bcd70-f13d-4759-874e-93b5bbe5e2fe]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:42 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 Nov 04 19:01:42 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:42 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88" returned: 0 in 0.410s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:42 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd Nov 04 19:01:42 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-88bd4b9b-c224-45a3-9d13-640bfccb02b7 tempest-GroupsV320Test-835197749 None] Created reservations ['984b9bd5-e9d7-40c3-bdff-250d20858404'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-88bd4b9b-c224-45a3-9d13-640bfccb02b7 tempest-GroupsV320Test-835197749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-88bd4b9b-c224-45a3-9d13-640bfccb02b7 tempest-GroupsV320Test-835197749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-88bd4b9b-c224-45a3-9d13-640bfccb02b7 tempest-GroupsV320Test-835197749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-88bd4b9b-c224-45a3-9d13-640bfccb02b7 tempest-GroupsV320Test-835197749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-88bd4b9b-c224-45a3-9d13-640bfccb02b7 tempest-GroupsV320Test-835197749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88bd4b9b-c224-45a3-9d13-640bfccb02b7 tempest-GroupsV320Test-835197749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:42 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:42 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:42 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-88bd4b9b-c224-45a3-9d13-640bfccb02b7 tempest-GroupsV320Test-835197749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.312s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:42 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-88bd4b9b-c224-45a3-9d13-640bfccb02b7 tempest-GroupsV320Test-835197749 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-88bd4b9b-c224-45a3-9d13-640bfccb02b7 tempest-GroupsV320Test-835197749 None] Delete group completed successfully. Nov 04 19:01:49 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd" returned: 0 in 7.362s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:49 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:01:49 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Converted 1024.00 MB image at 139.07 MB/s Nov 04 19:01:49 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd is being set with open permissions: ugo+rw: NotImplementedError Nov 04 19:01:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:49 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd Nov 04 19:01:49 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:49 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd" returned: 0 in 0.273s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Lock "cinder-quobyte-3bf7006d-5f0c-4681-bb75-2279ebb7fffd" released by "_copy_volume_from_snapshot" :: held 8.476s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Acquiring lock "cinder-quobyte-e0f43184-484c-4650-8385-0184e4047f42" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Lock "cinder-quobyte-e0f43184-484c-4650-8385-0184e4047f42" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Deleting offline snapshot e0f43184-484c-4650-8385-0184e4047f42 of volume afc8980b-3619-45e1-98df-32eb06865e88 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:01:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] snapshot_file for this snap is: volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:01:50 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34054b4-f089-4dec-8dbe-b53b23c71e4d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:50 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 Nov 04 19:01:50 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:50 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42" returned: 0 in 0.416s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afc8980b-3619-45e1-98df-32eb06865e88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:50 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[38266150-5ae1-4aec-b278-46d8447728f5]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:50 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 Nov 04 19:01:50 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:51 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88" returned: 0 in 0.602s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:51 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 Nov 04 19:01:51 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:51 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42" returned: 0 in 0.379s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:51 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42 Nov 04 19:01:51 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:51 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88.e0f43184-484c-4650-8385-0184e4047f42" returned: 0 in 0.279s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Lock "cinder-quobyte-e0f43184-484c-4650-8385-0184e4047f42" released by "_delete_snapshot" :: held 1.796s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.535s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.064s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] Creating offline snapshot ada78109-3fb3-40d2-91b4-d9be01b7456f of volume fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:01:51 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a3e2d9-d611-4af5-bb27-2bfc07d18abf]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:51 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-472062f0-e000-4b57-85eb-6964753f463f tempest-GroupsV314Test-1329055482 None] Create group from source-group-a8c08500-7807-4dc7-8dde-cc1c1898cb1e completed successfully. Nov 04 19:01:52 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b Nov 04 19:01:52 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:52 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b" returned: 0 in 0.446s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:52 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f 1G Nov 04 19:01:52 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Acquiring lock "cinder-quobyte-3bf7006d-5f0c-4681-bb75-2279ebb7fffd" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Lock "cinder-quobyte-3bf7006d-5f0c-4681-bb75-2279ebb7fffd" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:52 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[877fd2ed-202f-4e28-8e45-bdc93fe2fd05]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:52 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd Nov 04 19:01:52 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:52 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f 1G" returned: 0 in 0.599s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:52 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f Nov 04 19:01:52 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:53 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd" returned: 0 in 0.496s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:53 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd Nov 04 19:01:53 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:53 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f" returned: 0 in 0.362s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:53 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f is being set with open permissions: ugo+rw Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:53 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f Nov 04 19:01:53 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:53 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bf7006d-5f0c-4681-bb75-2279ebb7fffd" returned: 0 in 0.276s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Lock "cinder-quobyte-3bf7006d-5f0c-4681-bb75-2279ebb7fffd" released by "delete_volume" :: held 0.842s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Created reservations ['7e7ceae3-3ecd-41eb-8551-6afb7df0721b'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:53 devstack cinder-volume[87364]: WARNING cinder.quota [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1255093247 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1255093247, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:01:53 devstack cinder-volume[87364]: WARNING cinder.quota [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1255093247 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1255093247, it is now deprecated. Please use the default quota class for default quota. Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Created reservations ['7ca2e128-c8da-47c2-853c-e87c621bd99e', '7444e06c-28e5-45fc-852c-3ff078ec034a', 'd4223495-8085-406f-89b9-fdac458b4383', '5e3da54c-ad90-407e-a105-63016caed523'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:53 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f" returned: 0 in 0.310s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:53 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:53 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:53 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-120f84ba-dfc7-463b-ba00-adc9f0db16cb tempest-VolumesSnapshotListTestJSON-401588524 None] Create snapshot completed successfully Nov 04 19:01:53 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.284s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:53 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:53 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-dd55c6dd-cace-40a9-9ab6-8ba56da51b04 tempest-GroupsV314Test-1329055482 None] Delete group completed successfully. Nov 04 19:01:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Acquiring lock "cinder-quobyte-afc8980b-3619-45e1-98df-32eb06865e88" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Lock "cinder-quobyte-afc8980b-3619-45e1-98df-32eb06865e88" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:54 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5036c3bd-6999-42de-8ee6-487fa642d869]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:54 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 Nov 04 19:01:54 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:54 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88" returned: 0 in 0.405s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:54 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88 Nov 04 19:01:54 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:54 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afc8980b-3619-45e1-98df-32eb06865e88" returned: 0 in 0.352s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Lock "cinder-quobyte-afc8980b-3619-45e1-98df-32eb06865e88" released by "delete_volume" :: held 0.837s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:54 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Created reservations ['4f11bb04-305a-4177-a281-0fbc9d6a5bd4'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Created reservations ['0f2388ba-cc4f-4833-a5ef-ea5b546eb2ec', 'b69533fb-432d-4494-954b-cfb9e768c7db', '91b37f71-faae-406e-9ef9-e3a5d7d3bcc0', 'edd2857c-b995-4cb9-97b9-3e9d69b2f322'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:55 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:01:55 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:55 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.340s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:01:55 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b6219779-f637-4e21-a2f0-9410f7419a3d tempest-GroupsV314Test-1329055482 None] Delete group completed successfully. Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "cinder-ada78109-3fb3-40d2-91b4-d9be01b7456f-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-ada78109-3fb3-40d2-91b4-d9be01b7456f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "cinder-quobyte-ada78109-3fb3-40d2-91b4-d9be01b7456f" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-ada78109-3fb3-40d2-91b4-d9be01b7456f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Deleting offline snapshot ada78109-3fb3-40d2-91b4-d9be01b7456f of volume fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] snapshot_file for this snap is: volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2de13c-937e-4ab4-82d5-1a0e98dfdb2b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:55 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f Nov 04 19:01:55 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:56 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f" returned: 0 in 0.402s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:56 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f817a3ed-d3f6-4186-9a06-39b1fa5c875d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:56 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b Nov 04 19:01:56 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:56 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b" returned: 0 in 0.400s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:56 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f Nov 04 19:01:56 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:57 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f" returned: 0 in 0.526s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:57 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f Nov 04 19:01:57 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:57 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.ada78109-3fb3-40d2-91b4-d9be01b7456f" returned: 0 in 0.289s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-ada78109-3fb3-40d2-91b4-d9be01b7456f" released by "_delete_snapshot" :: held 1.732s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" released by "delete_snapshot" :: held 1.763s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Created reservations ['5f94f209-688e-4d64-ba64-5863c718e984', '259447c9-bd66-43d6-951b-bd7cf20846cc', '3696fc98-3037-4e9c-afe1-8027951a459a', '08d37cec-80b6-412b-a5ae-c07893e7ffdd'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Delete snapshot completed successfully. Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f13948f1-e338-4b21-9720-bb116ce2a8ac tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-ada78109-3fb3-40d2-91b4-d9be01b7456f-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "cinder-cc31d557-9e5b-40e2-b6b7-7d6e92daab3b-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-cc31d557-9e5b-40e2-b6b7-7d6e92daab3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "cinder-quobyte-cc31d557-9e5b-40e2-b6b7-7d6e92daab3b" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-cc31d557-9e5b-40e2-b6b7-7d6e92daab3b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Deleting offline snapshot cc31d557-9e5b-40e2-b6b7-7d6e92daab3b of volume fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] snapshot_file for this snap is: volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e173cfe-2377-4667-9a3e-3583ce17c2a9]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:58 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b Nov 04 19:01:58 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:58 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b" returned: 0 in 0.434s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:58 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b555dbe0-95f4-46af-afc9-a2000fd0b3e7]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:01:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:58 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 Nov 04 19:01:58 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:58 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7" returned: 0 in 0.483s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:01:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:58 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b Nov 04 19:01:58 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:59 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b" returned: 0 in 0.465s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:01:59 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b Nov 04 19:01:59 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:01:59 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Nov 04 19:01:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.cc31d557-9e5b-40e2-b6b7-7d6e92daab3b" returned: 0 in 0.297s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:01:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-cc31d557-9e5b-40e2-b6b7-7d6e92daab3b" released by "_delete_snapshot" :: held 1.853s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" released by "delete_snapshot" :: held 1.893s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:01:59 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Created reservations ['5842bbb6-e8b7-4df4-b531-77b33a4dbed5', 'db57b4b5-032f-430f-a0fd-dc9a929e7ffc', 'd6626bd3-127f-47c3-9398-bc392e7164ce', 'a39dd248-2303-4619-8f74-0b8a16d3254e'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:01:59 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Delete snapshot completed successfully. Nov 04 19:01:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4806e068-7328-4aae-9f9c-667386596461 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-cc31d557-9e5b-40e2-b6b7-7d6e92daab3b-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "cinder-39438965-1a59-43d8-a62c-ad51961419d7-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-39438965-1a59-43d8-a62c-ad51961419d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "cinder-quobyte-39438965-1a59-43d8-a62c-ad51961419d7" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-39438965-1a59-43d8-a62c-ad51961419d7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Deleting offline snapshot 39438965-1a59-43d8-a62c-ad51961419d7 of volume fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] snapshot_file for this snap is: volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b5575a-157a-43c2-8c4b-ec6c644f2356]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:00 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 Nov 04 19:02:00 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:00 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7" returned: 0 in 0.464s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da3718e-8355-4696-9664-bde344c7a238]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:00 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 Nov 04 19:02:00 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:01 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92" returned: 0 in 0.518s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:01 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 Nov 04 19:02:01 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:01 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7" returned: 0 in 0.418s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:01 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7 Nov 04 19:02:01 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:01 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92.39438965-1a59-43d8-a62c-ad51961419d7" returned: 0 in 0.300s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-39438965-1a59-43d8-a62c-ad51961419d7" released by "_delete_snapshot" :: held 1.889s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" released by "delete_snapshot" :: held 1.924s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:02 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Created reservations ['206e5b37-1049-4fda-a837-35c910f624a0', '64e26fc8-3d77-403a-a4c2-c2fee538b9f2', '33d741ff-8af6-4a32-8dc3-223c6890c41e', '15a80589-63e6-4469-92ad-519cc58d664f'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Delete snapshot completed successfully. Nov 04 19:02:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fcae7177-fb2b-4b97-9ff6-df3db3ae3fdd tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-39438965-1a59-43d8-a62c-ad51961419d7-delete_snapshot" released by "delete_snapshot" :: held 2.117s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "cinder-fa1e97c0-431c-4823-b0af-533ec1fb6a92-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-fa1e97c0-431c-4823-b0af-533ec1fb6a92-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" acquired by "delete_volume" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:02 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ec9635-8629-4513-a497-954727496025]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:02 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 Nov 04 19:02:02 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:02 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92" returned: 0 in 0.450s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:02 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92 Nov 04 19:02:02 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:03 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fa1e97c0-431c-4823-b0af-533ec1fb6a92" returned: 0 in 0.305s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-quobyte-fa1e97c0-431c-4823-b0af-533ec1fb6a92" released by "delete_volume" :: held 0.878s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Flow 'volume_create_manager' (02166915-52bf-4483-a734-9d74cfd6422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e979e2-547a-4e75-832b-ff4b7c6bc565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e979e2-547a-4e75-832b-ff4b7c6bc565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1446122154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c8e320-06fe-4ee3-8159-9e456c2c7449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d7b927ea9d4647b60526d28b396994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:03Z,use_quota=True,user_id='1f6133a47095491486371d47028c702f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009d1b27-9072-483d-87bb-deb9ec137d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009d1b27-9072-483d-87bb-deb9ec137d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695cbdf5-6578-42ee-a3f8-9005dbc54e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695cbdf5-6578-42ee-a3f8-9005dbc54e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c8e320-06fe-4ee3-8159-9e456c2c7449', 'volume_name': 'volume-89c8e320-06fe-4ee3-8159-9e456c2c7449', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a784faaf-0587-490a-b25f-3a9ec3d7d441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a784faaf-0587-490a-b25f-3a9ec3d7d441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897c0760-c5df-4199-b249-66d38f6b2dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:03 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Volume 89c8e320-06fe-4ee3-8159-9e456c2c7449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c8e320-06fe-4ee3-8159-9e456c2c7449', 'volume_size': 1} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1446122154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c8e320-06fe-4ee3-8159-9e456c2c7449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d7b927ea9d4647b60526d28b396994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:03Z,use_quota=True,user_id='1f6133a47095491486371d47028c702f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Creating volume 89c8e320-06fe-4ee3-8159-9e456c2c7449 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:02:03 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:03 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449 1073741824 Nov 04 19:02:03 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Created reservations ['08274ec6-449d-4e70-928b-162fc1111b48', '70158d97-271b-47a6-b36c-66a031e3c756', '15ac07e7-70f6-4e01-91ef-be2269277958', '8b5eff7f-8aa7-4003-94a9-b939bb490a57'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:03 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:02:03 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:03 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.289s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:03 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Deleted volume successfully. Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b9a938b5-3971-487e-b273-ed151d17db06 tempest-VolumesSnapshotListTestJSON-401588524 None] Lock "cinder-fa1e97c0-431c-4823-b0af-533ec1fb6a92-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:03 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449 1073741824" returned: 0 in 0.523s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:03 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449 Nov 04 19:02:03 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:04 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449" returned: 0 in 0.260s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:02:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897c0760-c5df-4199-b249-66d38f6b2dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c8e320-06fe-4ee3-8159-9e456c2c7449', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab4a4c5-250d-4d4b-aed9-a88cb20b946d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:04 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Volume volume-89c8e320-06fe-4ee3-8159-9e456c2c7449 (89c8e320-06fe-4ee3-8159-9e456c2c7449): created successfully Nov 04 19:02:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab4a4c5-250d-4d4b-aed9-a88cb20b946d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Flow 'volume_create_manager' (02166915-52bf-4483-a734-9d74cfd6422c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:04 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2844927a-c0fa-4339-ac25-ff5ed634d280 tempest-VolumesServicesTestJSON-907743331 None] Created volume successfully. Nov 04 19:02:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Acquiring lock "cinder-89c8e320-06fe-4ee3-8159-9e456c2c7449-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Lock "cinder-89c8e320-06fe-4ee3-8159-9e456c2c7449-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Acquiring lock "cinder-quobyte-89c8e320-06fe-4ee3-8159-9e456c2c7449" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Lock "cinder-quobyte-89c8e320-06fe-4ee3-8159-9e456c2c7449" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:05 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[559ba708-bf9a-4cc0-a64b-fffb143aba45]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:05 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449 Nov 04 19:02:05 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:06 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449" returned: 0 in 0.455s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:06 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449 Nov 04 19:02:06 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:06 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-89c8e320-06fe-4ee3-8159-9e456c2c7449" returned: 0 in 0.353s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Lock "cinder-quobyte-89c8e320-06fe-4ee3-8159-9e456c2c7449" released by "delete_volume" :: held 0.863s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:06 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Created reservations ['59cdcdab-75d7-4695-a415-e7340c89ad07', 'bf2d64c0-030e-4ee4-8197-8bcc23f9ac87', 'c8bc8730-9f22-47e6-8cff-33c06f9fe5f9', '60ff451d-b0f7-47e7-b473-cf2baeb716e6'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:06 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:02:06 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:07 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.367s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:07 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:07 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Deleted volume successfully. Nov 04 19:02:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6ceb90b4-1faa-4691-ba7f-4fb9bb8ef073 tempest-VolumesServicesTestJSON-907743331 None] Lock "cinder-89c8e320-06fe-4ee3-8159-9e456c2c7449-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Flow 'volume_create_manager' (89156d15-abb5-44e7-9fd3-0e0d78aed084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139d2094-8c54-4d58-8710-5800f3e00cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139d2094-8c54-4d58-8710-5800f3e00cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-304530999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2540c175-fe36-4ebf-b88b-fb3521310c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d835a6f02f14411b121313cd1bf9280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:15Z,use_quota=True,user_id='645037f646b94a5ab8ee4e2690499e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67eba76-b4cc-49c0-8e89-0f0d056bd614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67eba76-b4cc-49c0-8e89-0f0d056bd614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3e5f1a-6d87-43cd-a04b-4e548922cc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3e5f1a-6d87-43cd-a04b-4e548922cc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2540c175-fe36-4ebf-b88b-fb3521310c40', 'volume_name': 'volume-2540c175-fe36-4ebf-b88b-fb3521310c40', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d4289f-4418-4e67-a93f-a3e1790954e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d4289f-4418-4e67-a93f-a3e1790954e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (decc7ffc-f01f-4b22-84ef-bb01e1bb2bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:15 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Volume 2540c175-fe36-4ebf-b88b-fb3521310c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2540c175-fe36-4ebf-b88b-fb3521310c40', 'volume_size': 1} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-304530999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2540c175-fe36-4ebf-b88b-fb3521310c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d835a6f02f14411b121313cd1bf9280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:15Z,use_quota=True,user_id='645037f646b94a5ab8ee4e2690499e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Creating volume 2540c175-fe36-4ebf-b88b-fb3521310c40 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:02:15 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:02:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:15 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 1073741824 Nov 04 19:02:15 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:16 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 1073741824" returned: 0 in 0.591s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:16 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 Nov 04 19:02:16 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:16 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:02:16 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:16 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40" returned: 0 in 0.515s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (decc7ffc-f01f-4b22-84ef-bb01e1bb2bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2540c175-fe36-4ebf-b88b-fb3521310c40', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c3314e-00e0-4172-96cd-be2db5eeb07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:16 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.447s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:16 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Volume volume-2540c175-fe36-4ebf-b88b-fb3521310c40 (2540c175-fe36-4ebf-b88b-fb3521310c40): created successfully Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c3314e-00e0-4172-96cd-be2db5eeb07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Flow 'volume_create_manager' (89156d15-abb5-44e7-9fd3-0e0d78aed084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:02:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:02:16 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1ce2c4a1-0cbe-4e4d-b61b-9d52bbadca61 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Created volume successfully. Nov 04 19:02:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Creating offline snapshot 8d31253c-c9d2-4210-9d08-9ff627972c61 of volume 2540c175-fe36-4ebf-b88b-fb3521310c40 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:02:17 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c54bc4-cf24-4d3a-9fc0-9cffb62df1cd]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:17 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 Nov 04 19:02:17 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:18 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40" returned: 0 in 0.477s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:18 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 1G Nov 04 19:02:18 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:18 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 1G" returned: 0 in 0.683s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2540c175-fe36-4ebf-b88b-fb3521310c40 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:19 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2540c175-fe36-4ebf-b88b-fb3521310c40 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 Nov 04 19:02:19 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:19 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2540c175-fe36-4ebf-b88b-fb3521310c40 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61" returned: 0 in 0.392s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:19 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 is being set with open permissions: ugo+rw Nov 04 19:02:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:19 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 Nov 04 19:02:19 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:19 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61" returned: 0 in 0.378s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:19 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.info Nov 04 19:02:19 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:20 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.info" returned: 0 in 0.384s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:20 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.info is being set with open permissions: ugo+rw Nov 04 19:02:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:20 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.info Nov 04 19:02:20 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:20 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.info" returned: 0 in 0.347s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.811s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:20 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f0a45d41-95ab-4d18-9b4b-d97c77cbef75 tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Create snapshot completed successfully Nov 04 19:02:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Acquiring lock "cinder-8d31253c-c9d2-4210-9d08-9ff627972c61-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "cinder-8d31253c-c9d2-4210-9d08-9ff627972c61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Acquiring lock "cinder-quobyte-2540c175-fe36-4ebf-b88b-fb3521310c40" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "cinder-quobyte-2540c175-fe36-4ebf-b88b-fb3521310c40" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Acquiring lock "cinder-quobyte-8d31253c-c9d2-4210-9d08-9ff627972c61" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "cinder-quobyte-8d31253c-c9d2-4210-9d08-9ff627972c61" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Deleting offline snapshot 8d31253c-c9d2-4210-9d08-9ff627972c61 of volume 2540c175-fe36-4ebf-b88b-fb3521310c40 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:02:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] snapshot_file for this snap is: volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:02:21 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cc122c-1d61-4263-b9cc-310ad5e80d9e]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:21 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 Nov 04 19:02:21 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:22 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61" returned: 0 in 0.551s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2540c175-fe36-4ebf-b88b-fb3521310c40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:02:22 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1319fd9-7836-41ed-ae09-4f8f0e903223]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:22 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 Nov 04 19:02:22 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:22 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40" returned: 0 in 0.426s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:22 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 Nov 04 19:02:22 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:23 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61" returned: 0 in 0.490s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:23 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61 Nov 04 19:02:23 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:23 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40.8d31253c-c9d2-4210-9d08-9ff627972c61" returned: 0 in 0.329s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "cinder-quobyte-8d31253c-c9d2-4210-9d08-9ff627972c61" released by "_delete_snapshot" :: held 1.952s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "cinder-quobyte-2540c175-fe36-4ebf-b88b-fb3521310c40" released by "delete_snapshot" :: held 1.978s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:23 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Created reservations ['fe80685d-d968-45c4-b0b0-256e86696b2c', 'a4e3639a-8fa0-4ea8-9e15-1b8c11386c4d', '245cc36b-a471-4a26-bddc-e9ad60a31708', '881e99a2-6ea1-49da-98eb-b5296d52a029'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:23 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Delete snapshot completed successfully. Nov 04 19:02:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-821fff46-4d75-478b-9b43-64e43b86825a tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "cinder-8d31253c-c9d2-4210-9d08-9ff627972c61-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Acquiring lock "cinder-2540c175-fe36-4ebf-b88b-fb3521310c40-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "cinder-2540c175-fe36-4ebf-b88b-fb3521310c40-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Acquiring lock "cinder-quobyte-2540c175-fe36-4ebf-b88b-fb3521310c40" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:02:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "cinder-quobyte-2540c175-fe36-4ebf-b88b-fb3521310c40" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:02:25 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[da99972e-f383-4611-91d9-0390eda2fe88]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:02:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:25 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 Nov 04 19:02:25 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:25 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40" returned: 0 in 0.435s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:25 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40 Nov 04 19:02:25 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:25 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2540c175-fe36-4ebf-b88b-fb3521310c40" returned: 0 in 0.343s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "cinder-quobyte-2540c175-fe36-4ebf-b88b-fb3521310c40" released by "delete_volume" :: held 0.869s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:25 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:DELETE=6,cinder:SELECT=97,cinder:INSERT=30,cinder:UPDATE=117 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:02:25 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=121,cinder:UPDATE=108,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:02:25 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Created reservations ['9cc58bd2-088e-4131-a655-0fab7ec58ac6', '55b3d676-7b58-4d21-a306-968bbe11b9e8', '025634ca-9447-409b-9e76-deabe90e2c82', '19f03ff3-7a5b-4fab-8f0d-d5111f0e48f7'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:02:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:26 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:02:26 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:26 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.358s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:26 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:02:26 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Deleted volume successfully. Nov 04 19:02:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6d063429-b667-4f3a-97ef-665d8c3cb80b tempest-VolumeSnapshotQuotasNegativeTestJSON-726421297 None] Lock "cinder-2540c175-fe36-4ebf-b88b-fb3521310c40-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:02:36 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=10,cinder:SELECT=2 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:02:36 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Flow 'volume_create_manager' (7efceafb-c246-45a3-bbd0-bdc3aa685300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76741c3d-ec92-4cd2-85cb-7160939375c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76741c3d-ec92-4cd2-85cb-7160939375c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-866041508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f133d91-5ec9-4093-9302-2d3d1dc13327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45bcf207ce4d24b3bc9e6dbb55f75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:54Z,use_quota=True,user_id='c30202278c294f6ca19904072d109efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2197a303-c622-465a-91be-2dd3893a93b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2197a303-c622-465a-91be-2dd3893a93b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fdaeaf-f568-434f-b07b-4fa05c24a449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fdaeaf-f568-434f-b07b-4fa05c24a449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f133d91-5ec9-4093-9302-2d3d1dc13327', 'volume_name': 'volume-5f133d91-5ec9-4093-9302-2d3d1dc13327', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0240a1a0-97ee-462b-a80c-e99bd158eced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0240a1a0-97ee-462b-a80c-e99bd158eced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d33d8c4-5a5f-4a0f-a0a6-b989e2e11dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:53 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Volume 5f133d91-5ec9-4093-9302-2d3d1dc13327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f133d91-5ec9-4093-9302-2d3d1dc13327', 'volume_size': 1} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-866041508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f133d91-5ec9-4093-9302-2d3d1dc13327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45bcf207ce4d24b3bc9e6dbb55f75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:54Z,use_quota=True,user_id='c30202278c294f6ca19904072d109efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Creating volume 5f133d91-5ec9-4093-9302-2d3d1dc13327 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:02:53 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:02:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:53 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327 1073741824 Nov 04 19:02:53 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:54 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327 1073741824" returned: 0 in 0.535s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:54 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327 Nov 04 19:02:54 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:54 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327" returned: 0 in 0.468s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:02:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d33d8c4-5a5f-4a0f-a0a6-b989e2e11dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f133d91-5ec9-4093-9302-2d3d1dc13327', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494a78f0-a6f9-4a9a-86f5-b93651f4faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:55 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Volume volume-5f133d91-5ec9-4093-9302-2d3d1dc13327 (5f133d91-5ec9-4093-9302-2d3d1dc13327): created successfully Nov 04 19:02:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494a78f0-a6f9-4a9a-86f5-b93651f4faad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Flow 'volume_create_manager' (7efceafb-c246-45a3-bbd0-bdc3aa685300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:55 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a588820e-02cc-4ee4-a3a9-0b1bed9a2f2d tempest-VolumesListAdminTestJSON-276169897 None] Created volume successfully. Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Flow 'volume_create_manager' (7ebbe309-11eb-4162-8f49-003f07ca7602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e311ca9-105d-44aa-87eb-156f335b5cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e311ca9-105d-44aa-87eb-156f335b5cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1139705249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b867bd-c1c0-4eb9-8b64-1219c052e078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45bcf207ce4d24b3bc9e6dbb55f75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:57Z,use_quota=True,user_id='c30202278c294f6ca19904072d109efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bda4124-5aa9-4cf5-a583-755c4e144aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bda4124-5aa9-4cf5-a583-755c4e144aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5079c04-ce74-4450-9d8a-ddc5b3accd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5079c04-ce74-4450-9d8a-ddc5b3accd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14b867bd-c1c0-4eb9-8b64-1219c052e078', 'volume_name': 'volume-14b867bd-c1c0-4eb9-8b64-1219c052e078', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75de3b26-e0cc-4dab-ad0c-2ca41b753ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75de3b26-e0cc-4dab-ad0c-2ca41b753ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02094201-e432-4530-8830-33b57a2f6155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:57 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Volume 14b867bd-c1c0-4eb9-8b64-1219c052e078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14b867bd-c1c0-4eb9-8b64-1219c052e078', 'volume_size': 1} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1139705249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b867bd-c1c0-4eb9-8b64-1219c052e078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45bcf207ce4d24b3bc9e6dbb55f75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:02:57Z,use_quota=True,user_id='c30202278c294f6ca19904072d109efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Creating volume 14b867bd-c1c0-4eb9-8b64-1219c052e078 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:02:57 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:02:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:57 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078 1073741824 Nov 04 19:02:57 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:58 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078 1073741824" returned: 0 in 0.799s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:02:58 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078 Nov 04 19:02:58 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:02:58 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Nov 04 19:02:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078" returned: 0 in 0.285s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:02:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:02:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:02:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02094201-e432-4530-8830-33b57a2f6155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b867bd-c1c0-4eb9-8b64-1219c052e078', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db35922-c329-4f2a-8de9-04324b8e8e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:02:58 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Volume volume-14b867bd-c1c0-4eb9-8b64-1219c052e078 (14b867bd-c1c0-4eb9-8b64-1219c052e078): created successfully Nov 04 19:02:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db35922-c329-4f2a-8de9-04324b8e8e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:02:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Flow 'volume_create_manager' (7ebbe309-11eb-4162-8f49-003f07ca7602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:02:58 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-edd2e19c-7e90-4105-aebf-a78d35218d45 tempest-VolumesListAdminTestJSON-276169897 None] Created volume successfully. Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Flow 'volume_create_manager' (d64489c2-1eb4-4aa6-a045-86a09f192326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b7c1f4-6e17-47f1-b863-78c7773b2026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b7c1f4-6e17-47f1-b863-78c7773b2026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-836679162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ca2b1b-7e26-4c7c-ad00-96405c422eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45bcf207ce4d24b3bc9e6dbb55f75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:00Z,use_quota=True,user_id='c30202278c294f6ca19904072d109efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3cb28f-4f49-4041-bf1f-c7e5b82947b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3cb28f-4f49-4041-bf1f-c7e5b82947b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5bd0e9-9acb-44b4-81cc-b9710dfb6580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5bd0e9-9acb-44b4-81cc-b9710dfb6580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ca2b1b-7e26-4c7c-ad00-96405c422eb4', 'volume_name': 'volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af31e8a1-7b26-4776-a957-ca0b10aa9493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af31e8a1-7b26-4776-a957-ca0b10aa9493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5cd724f-6138-4b6b-84f7-d506ba4ec604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:00 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Volume a8ca2b1b-7e26-4c7c-ad00-96405c422eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4', 'volume_size': 1} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-836679162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ca2b1b-7e26-4c7c-ad00-96405c422eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45bcf207ce4d24b3bc9e6dbb55f75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:00Z,use_quota=True,user_id='c30202278c294f6ca19904072d109efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Creating volume a8ca2b1b-7e26-4c7c-ad00-96405c422eb4 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:00 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:00 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4 1073741824 Nov 04 19:03:00 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (6fe08d02-6807-4643-8f3c-35d7e3cdfe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b666b2d-6cc1-472f-8cf3-4b4215ca82c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b666b2d-6cc1-472f-8cf3-4b4215ca82c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-24872188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c0285a-fac4-484f-b350-93b98cf90381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:01Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69be6dde-f3cc-41e2-953d-481a662bf4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69be6dde-f3cc-41e2-953d-481a662bf4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f7c8d5-30b0-48dd-a2e2-5359fae04aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f7c8d5-30b0-48dd-a2e2-5359fae04aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c0285a-fac4-484f-b350-93b98cf90381', 'volume_name': 'volume-78c0285a-fac4-484f-b350-93b98cf90381', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2e6fb2-030f-4357-bf6a-740287ba7f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2e6fb2-030f-4357-bf6a-740287ba7f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d68b785-ba92-4216-aa4f-eed7246e0e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:00 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Volume 78c0285a-fac4-484f-b350-93b98cf90381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c0285a-fac4-484f-b350-93b98cf90381', 'volume_size': 1} Nov 04 19:03:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:01 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4 1073741824" returned: 0 in 0.603s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:01 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4 Nov 04 19:03:01 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:01 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4" returned: 0 in 0.262s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-24872188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c0285a-fac4-484f-b350-93b98cf90381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:01Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Creating volume 78c0285a-fac4-484f-b350-93b98cf90381 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:01 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:01 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381 1073741824 Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5cd724f-6138-4b6b-84f7-d506ba4ec604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:01 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b99ba5-d7d0-470a-952a-3d86d3a77bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:01 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Volume volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4 (a8ca2b1b-7e26-4c7c-ad00-96405c422eb4): created successfully Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b99ba5-d7d0-470a-952a-3d86d3a77bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Flow 'volume_create_manager' (d64489c2-1eb4-4aa6-a045-86a09f192326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ee4c33ef-69bc-4b37-9521-dfbc438349ac tempest-VolumesListAdminTestJSON-276169897 None] Created volume successfully. Nov 04 19:03:01 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381 1073741824" returned: 0 in 0.491s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:01 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381 Nov 04 19:03:01 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:02 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381" returned: 0 in 0.285s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d68b785-ba92-4216-aa4f-eed7246e0e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c0285a-fac4-484f-b350-93b98cf90381', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779b48b6-e7aa-430e-8788-64c6ef7673a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:02 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Volume volume-78c0285a-fac4-484f-b350-93b98cf90381 (78c0285a-fac4-484f-b350-93b98cf90381): created successfully Nov 04 19:03:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779b48b6-e7aa-430e-8788-64c6ef7673a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (6fe08d02-6807-4643-8f3c-35d7e3cdfe0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-51b27639-a61f-47ed-b827-7596447d4978 tempest-VolumesActionsTest-1927855345 None] Created volume successfully. Nov 04 19:03:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d4c1ac69-c713-4652-8f76-8094689a3e8b tempest-VolumesActionsTest-1927855345 None] Acquiring lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381" by "attach_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d4c1ac69-c713-4652-8f76-8094689a3e8b tempest-VolumesActionsTest-1927855345 None] Lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381" acquired by "attach_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d4c1ac69-c713-4652-8f76-8094689a3e8b tempest-VolumesActionsTest-1927855345 None] Attaching volume 78c0285a-fac4-484f-b350-93b98cf90381 to instance ef136502-5337-4e20-9b86-806daaaff481 at mountpoint /dev/vdb on host None. Nov 04 19:03:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d4c1ac69-c713-4652-8f76-8094689a3e8b tempest-VolumesActionsTest-1927855345 None] Attach volume completed successfully. Nov 04 19:03:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d4c1ac69-c713-4652-8f76-8094689a3e8b tempest-VolumesActionsTest-1927855345 None] Lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381" released by "attach_volume" :: held 0.134s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Flow 'volume_create_manager' (8dc296ba-6e85-4103-8e52-fc515749bbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c955355e-ebf8-404a-9e3d-9c1450b7b4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c955355e-ebf8-404a-9e3d-9c1450b7b4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65652a5-082b-4b1d-8a8b-91cf54e44f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260bb2669df24ec0ac1635895c8e722d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:03Z,use_quota=True,user_id='0e1e5bab5e23478384c7928e1a07ca5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425b2589-5036-47ba-ba12-f7992bea11d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425b2589-5036-47ba-ba12-f7992bea11d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9701cbda-5989-4a82-9984-72fa66537c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9701cbda-5989-4a82-9984-72fa66537c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65652a5-082b-4b1d-8a8b-91cf54e44f54', 'volume_name': 'volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f88b624-3f6c-4802-8008-35ec2f1e978c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f88b624-3f6c-4802-8008-35ec2f1e978c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413c0b65-dcc2-4d04-bd61-767b38a87bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:03 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Volume b65652a5-082b-4b1d-8a8b-91cf54e44f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54', 'volume_size': 1} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65652a5-082b-4b1d-8a8b-91cf54e44f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260bb2669df24ec0ac1635895c8e722d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:03Z,use_quota=True,user_id='0e1e5bab5e23478384c7928e1a07ca5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Creating volume b65652a5-082b-4b1d-8a8b-91cf54e44f54 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:03 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:03 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54 1073741824 Nov 04 19:03:03 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:03 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f2e7bdc3-5ac1-4c0d-8270-c436f52a9b53 tempest-VolumesActionsTest-252020575 None] Terminate volume connection completed successfully. Nov 04 19:03:03 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54 1073741824" returned: 0 in 0.471s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f2e7bdc3-5ac1-4c0d-8270-c436f52a9b53 tempest-VolumesActionsTest-252020575 None] Acquiring lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381-detach_volume" by "detach_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:03 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54 Nov 04 19:03:03 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f2e7bdc3-5ac1-4c0d-8270-c436f52a9b53 tempest-VolumesActionsTest-252020575 None] Lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:03 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f2e7bdc3-5ac1-4c0d-8270-c436f52a9b53 tempest-VolumesActionsTest-252020575 None] Detaching volume 78c0285a-fac4-484f-b350-93b98cf90381 from instance ef136502-5337-4e20-9b86-806daaaff481. Nov 04 19:03:03 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f2e7bdc3-5ac1-4c0d-8270-c436f52a9b53 tempest-VolumesActionsTest-252020575 None] Detach volume completed successfully. Nov 04 19:03:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f2e7bdc3-5ac1-4c0d-8270-c436f52a9b53 tempest-VolumesActionsTest-252020575 None] Lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:04 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54" returned: 0 in 0.303s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413c0b65-dcc2-4d04-bd61-767b38a87bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ea466e-a8ff-4375-b37e-007a91fd5a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0056cb23-5fde-42d7-950f-f21dd00c8d96 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381-detach_volume" by "detach_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:04 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Volume volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54 (b65652a5-082b-4b1d-8a8b-91cf54e44f54): created successfully Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ea466e-a8ff-4375-b37e-007a91fd5a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Flow 'volume_create_manager' (8dc296ba-6e85-4103-8e52-fc515749bbf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0056cb23-5fde-42d7-950f-f21dd00c8d96 tempest-VolumesActionsTest-1927855345 None] Lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:04 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0056cb23-5fde-42d7-950f-f21dd00c8d96 tempest-VolumesActionsTest-1927855345 None] Volume detach called, but volume not attached. Nov 04 19:03:04 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4cdbd115-d77e-4687-ba56-dc9792138d76 tempest-VolumesListAdminTestJSON-1287389979 None] Created volume successfully. Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0056cb23-5fde-42d7-950f-f21dd00c8d96 tempest-VolumesActionsTest-1927855345 None] Lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "cinder-quobyte-78c0285a-fac4-484f-b350-93b98cf90381" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Lock "cinder-quobyte-78c0285a-fac4-484f-b350-93b98cf90381" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[46df6e10-69d5-47dd-8221-5b478da54bb5]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:04 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381 Nov 04 19:03:04 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:04 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381" returned: 0 in 0.379s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:04 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381 Nov 04 19:03:04 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:05 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78c0285a-fac4-484f-b350-93b98cf90381" returned: 0 in 0.282s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Lock "cinder-quobyte-78c0285a-fac4-484f-b350-93b98cf90381" released by "delete_volume" :: held 0.708s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Created reservations ['9fd01e96-4393-431a-81a2-5d66b8e20d67', '9b18f50b-2fa1-4b79-b3ef-855c06eaba29', '63ec702d-86c7-4f23-8750-ccdcb96e67fc', '254383dc-3045-4f81-aebf-5a73ba79cd25'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Acquiring lock "cinder-b65652a5-082b-4b1d-8a8b-91cf54e44f54-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Lock "cinder-b65652a5-082b-4b1d-8a8b-91cf54e44f54-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:05 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:05 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Acquiring lock "cinder-quobyte-b65652a5-082b-4b1d-8a8b-91cf54e44f54" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Lock "cinder-quobyte-b65652a5-082b-4b1d-8a8b-91cf54e44f54" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "cinder-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec04447-7026-466c-bdc8-4d227c40230c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "cinder-quobyte-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-quobyte-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43632af-6205-4ae9-b576-0b72f06e3b9c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:05 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54 Nov 04 19:03:05 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:05 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.477s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Deleted volume successfully. Nov 04 19:03:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f5577885-3af6-49b8-ad51-ccbc40006394 tempest-VolumesActionsTest-1927855345 None] Lock "cinder-78c0285a-fac4-484f-b350-93b98cf90381-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:06 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4 Nov 04 19:03:06 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:06 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54" returned: 0 in 0.662s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:06 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54 Nov 04 19:03:06 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:06 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4" returned: 0 in 0.687s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:06 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4 Nov 04 19:03:06 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:06 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b65652a5-082b-4b1d-8a8b-91cf54e44f54" returned: 0 in 0.402s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Lock "cinder-quobyte-b65652a5-082b-4b1d-8a8b-91cf54e44f54" released by "delete_volume" :: held 1.167s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Created reservations ['ccec96de-1c85-499e-8dc2-28c0619ec94f', '96122fe7-c461-47ed-bda2-37df4b650433', 'ea6138bd-da72-487d-b46d-c04795cc3d36', '2a6bdc39-73b5-44f5-b349-cdb285895c85'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:06 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4" returned: 0 in 0.388s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-quobyte-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4" released by "delete_volume" :: held 1.134s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:06 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:06 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:06 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Created reservations ['2ce4c6aa-68bd-4afd-84f4-542adb36f802', 'b812dd97-f78d-4dc1-8d00-3d83babb8ae0', '9319fc57-5982-473a-8da6-e5ab73e53ede', 'b38381e8-71fd-45dc-9014-0a9140756298'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:07 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:07 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:07 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.328s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:07 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Deleted volume successfully. Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2c12ab5b-9fcc-439b-ba57-57186a149571 tempest-VolumesListAdminTestJSON-1287389979 None] Lock "cinder-b65652a5-082b-4b1d-8a8b-91cf54e44f54-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:07 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.293s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:07 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Deleted volume successfully. Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-93f5324a-b05e-4146-b848-c5a35d5cbd9a tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-a8ca2b1b-7e26-4c7c-ad00-96405c422eb4-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "cinder-14b867bd-c1c0-4eb9-8b64-1219c052e078-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-14b867bd-c1c0-4eb9-8b64-1219c052e078-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "cinder-quobyte-14b867bd-c1c0-4eb9-8b64-1219c052e078" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-quobyte-14b867bd-c1c0-4eb9-8b64-1219c052e078" acquired by "delete_volume" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a96abe-29d5-47ff-ab99-ea98ca331214]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:08 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078 Nov 04 19:03:08 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:08 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078" returned: 0 in 0.395s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:08 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078 Nov 04 19:03:08 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:08 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-14b867bd-c1c0-4eb9-8b64-1219c052e078" returned: 0 in 0.294s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-quobyte-14b867bd-c1c0-4eb9-8b64-1219c052e078" released by "delete_volume" :: held 0.747s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Created reservations ['21e23d16-b995-4a80-ad84-d5e41264c80e', 'b02b12d0-bcf1-4f5f-bb08-049ab03d7b60', '5d2b93c2-9530-42e2-a839-f15b54904db0', '8a3a1f1c-ddd8-473c-949e-df016d85428e'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:08 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:08 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "cinder-5f133d91-5ec9-4093-9302-2d3d1dc13327-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:09 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.337s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-5f133d91-5ec9-4093-9302-2d3d1dc13327-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:09 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Deleted volume successfully. Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-aa16f192-cdec-49f2-badf-060ce0a9f664 tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-14b867bd-c1c0-4eb9-8b64-1219c052e078-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "cinder-quobyte-5f133d91-5ec9-4093-9302-2d3d1dc13327" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-quobyte-5f133d91-5ec9-4093-9302-2d3d1dc13327" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (234a860e-44d7-487d-a9d2-6dfc8254c275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e946860c-7c4f-4157-909a-1a7df4f17b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[440d5779-fa83-4622-bd70-e4e2fb5b9269]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e946860c-7c4f-4157-909a-1a7df4f17b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-218823618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062e94ba-8ffb-4c21-a0f1-f72f39cd0106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:09Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2542adc-5fc9-414d-991f-7a7c53b5cb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2542adc-5fc9-414d-991f-7a7c53b5cb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23cf267-e1dc-489e-9bc2-66fe032bb206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23cf267-e1dc-489e-9bc2-66fe032bb206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062e94ba-8ffb-4c21-a0f1-f72f39cd0106', 'volume_name': 'volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce364fb5-518a-4cd9-81af-5848e3a6fdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce364fb5-518a-4cd9-81af-5848e3a6fdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a92c79a-469b-4139-870c-67436162d41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:09 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Volume 062e94ba-8ffb-4c21-a0f1-f72f39cd0106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106', 'volume_size': 1} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-218823618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062e94ba-8ffb-4c21-a0f1-f72f39cd0106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:09Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Creating volume 062e94ba-8ffb-4c21-a0f1-f72f39cd0106 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:09 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:09 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106 1073741824 Nov 04 19:03:09 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:09 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327 Nov 04 19:03:09 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:09 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327" returned: 0 in 0.406s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:09 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327 Nov 04 19:03:09 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:09 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106 1073741824" returned: 0 in 0.473s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:10 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106 Nov 04 19:03:10 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:10 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5f133d91-5ec9-4093-9302-2d3d1dc13327" returned: 0 in 0.288s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-quobyte-5f133d91-5ec9-4093-9302-2d3d1dc13327" released by "delete_volume" :: held 0.767s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Created reservations ['aff8f564-9242-486e-9cad-b0f0bc5b68cc', '4ad0a1d6-23af-4587-bef5-ace8e8101538', '850ae361-42af-49c2-833b-7f2bf4181f91', 'c3b83cca-27bb-41f3-89bf-7cd0757023db'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:10 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106" returned: 0 in 0.311s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:10 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:10 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a92c79a-469b-4139-870c-67436162d41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feee969a-a58a-4cb6-ac37-f17533e912c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:10 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Volume volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106 (062e94ba-8ffb-4c21-a0f1-f72f39cd0106): created successfully Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feee969a-a58a-4cb6-ac37-f17533e912c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (234a860e-44d7-487d-a9d2-6dfc8254c275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:10 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1a726540-4024-4997-b3eb-17913344a1c4 tempest-VolumesActionsTest-1927855345 None] Created volume successfully. Nov 04 19:03:10 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:10 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Deleted volume successfully. Nov 04 19:03:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4ab10a1d-9f54-4ada-96f6-2fd1370359d7 tempest-VolumesListAdminTestJSON-276169897 None] Lock "cinder-5f133d91-5ec9-4093-9302-2d3d1dc13327-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Acquiring lock "cinder-062e94ba-8ffb-4c21-a0f1-f72f39cd0106-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Lock "cinder-062e94ba-8ffb-4c21-a0f1-f72f39cd0106-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Acquiring lock "cinder-quobyte-062e94ba-8ffb-4c21-a0f1-f72f39cd0106" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Lock "cinder-quobyte-062e94ba-8ffb-4c21-a0f1-f72f39cd0106" acquired by "delete_volume" :: waited 0.043s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:11 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0381fcb6-981f-43c2-9b85-cf5b80fc3abe]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:12 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106 Nov 04 19:03:12 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:12 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106" returned: 0 in 0.403s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:12 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106 Nov 04 19:03:12 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:12 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-062e94ba-8ffb-4c21-a0f1-f72f39cd0106" returned: 0 in 0.313s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Lock "cinder-quobyte-062e94ba-8ffb-4c21-a0f1-f72f39cd0106" released by "delete_volume" :: held 0.779s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:12 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Created reservations ['c2055155-7d0f-42d0-9a35-395e7ab4a7d7', '27e9a93f-4d3d-4aa0-b89d-324d9248e146', 'fb886fd6-52a8-498a-bf1c-12da3489a5ee', '4b053402-1bab-42f6-a009-68b4b985c488'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:12 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:12 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:13 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.332s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:13 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Deleted volume successfully. Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-afaafb30-a531-48d8-9d95-f7410d42d3de tempest-VolumesActionsTest-252020575 None] Lock "cinder-062e94ba-8ffb-4c21-a0f1-f72f39cd0106-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (de5ba4c8-1f7a-44fe-bedb-c45f176e3915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37cab4ad-3ff5-4d00-ad11-74d0d302a5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37cab4ad-3ff5-4d00-ad11-74d0d302a5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1902400848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04dfc304-1b9b-43d9-af78-30c30f005a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:14Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1651f70a-5474-4b98-859a-41f38af0bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1651f70a-5474-4b98-859a-41f38af0bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277b6ac7-0e3e-45ed-be49-923e2edba96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277b6ac7-0e3e-45ed-be49-923e2edba96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04dfc304-1b9b-43d9-af78-30c30f005a82', 'volume_name': 'volume-04dfc304-1b9b-43d9-af78-30c30f005a82', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6cc6ba-6d31-439f-aa70-9f4c4541d792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6cc6ba-6d31-439f-aa70-9f4c4541d792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f45eedf-d850-47c2-979c-b3c0e938b81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:13 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Volume 04dfc304-1b9b-43d9-af78-30c30f005a82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04dfc304-1b9b-43d9-af78-30c30f005a82', 'volume_size': 1} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1902400848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04dfc304-1b9b-43d9-af78-30c30f005a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:14Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Creating volume 04dfc304-1b9b-43d9-af78-30c30f005a82 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:13 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:13 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82 1073741824 Nov 04 19:03:13 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:14 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82 1073741824" returned: 0 in 0.536s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:14 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82 Nov 04 19:03:14 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:14 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82" returned: 0 in 0.268s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f45eedf-d850-47c2-979c-b3c0e938b81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04dfc304-1b9b-43d9-af78-30c30f005a82', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d7a2bb-fb2f-4eb9-94e1-6528d6560af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:14 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Volume volume-04dfc304-1b9b-43d9-af78-30c30f005a82 (04dfc304-1b9b-43d9-af78-30c30f005a82): created successfully Nov 04 19:03:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d7a2bb-fb2f-4eb9-94e1-6528d6560af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (de5ba4c8-1f7a-44fe-bedb-c45f176e3915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:14 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8ba19c3a-4c9d-4c99-9fd1-1667a101f757 tempest-VolumesActionsTest-1927855345 None] Created volume successfully. Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Flow 'volume_create_manager' (984c9718-fe8f-42ca-abeb-421b5fdd3a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0efb381-2db4-412a-99de-97e3df5f7abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0efb381-2db4-412a-99de-97e3df5f7abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-958042099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab005ab-9ae9-46ca-9bbe-c9995217f534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a4c3de795447babee93f2d8fca8dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:15Z,use_quota=True,user_id='b3d4dcdac9c04d958b5b2733bc3e7668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64dae6f2-72eb-4346-93f4-a15af6a06b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64dae6f2-72eb-4346-93f4-a15af6a06b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43dc31ac-a561-4517-98c9-128ba2a7a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43dc31ac-a561-4517-98c9-128ba2a7a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab005ab-9ae9-46ca-9bbe-c9995217f534', 'volume_name': 'volume-cab005ab-9ae9-46ca-9bbe-c9995217f534', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43669775-6f8f-4f04-9728-74a55a9b60fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43669775-6f8f-4f04-9728-74a55a9b60fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff7c96-0b18-4ea0-90bd-9c956679c9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:15 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Volume cab005ab-9ae9-46ca-9bbe-c9995217f534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab005ab-9ae9-46ca-9bbe-c9995217f534', 'volume_size': 1} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-958042099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab005ab-9ae9-46ca-9bbe-c9995217f534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a4c3de795447babee93f2d8fca8dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:15Z,use_quota=True,user_id='b3d4dcdac9c04d958b5b2733bc3e7668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Creating volume cab005ab-9ae9-46ca-9bbe-c9995217f534 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:15 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:15 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534 1073741824 Nov 04 19:03:15 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:15 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534 1073741824" returned: 0 in 0.476s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:15 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534 Nov 04 19:03:15 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Acquiring lock "cinder-04dfc304-1b9b-43d9-af78-30c30f005a82-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Lock "cinder-04dfc304-1b9b-43d9-af78-30c30f005a82-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Acquiring lock "cinder-quobyte-04dfc304-1b9b-43d9-af78-30c30f005a82" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Lock "cinder-quobyte-04dfc304-1b9b-43d9-af78-30c30f005a82" acquired by "delete_volume" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:16 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534" returned: 0 in 0.329s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff7c96-0b18-4ea0-90bd-9c956679c9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab005ab-9ae9-46ca-9bbe-c9995217f534', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d75851a-4198-4fcd-ba7d-e6d2674cea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89fcba1-0a26-4352-bf79-c7be7a62f3a1]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:16 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Volume volume-cab005ab-9ae9-46ca-9bbe-c9995217f534 (cab005ab-9ae9-46ca-9bbe-c9995217f534): created successfully Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d75851a-4198-4fcd-ba7d-e6d2674cea6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Flow 'volume_create_manager' (984c9718-fe8f-42ca-abeb-421b5fdd3a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:16 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6c5de9f6-bdde-4b60-9e61-e68739b28c3d tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Created volume successfully. Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:16 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82 Nov 04 19:03:16 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:16 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:16 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:16 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.305s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:03:16 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82" returned: 0 in 0.427s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:16 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82 Nov 04 19:03:16 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:16 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-04dfc304-1b9b-43d9-af78-30c30f005a82" returned: 0 in 0.267s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Lock "cinder-quobyte-04dfc304-1b9b-43d9-af78-30c30f005a82" released by "delete_volume" :: held 0.764s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Created reservations ['5a24956b-f64e-4ab0-b70d-e29b212ed955', 'f41cfb7e-56fb-4a00-8d03-331028609604', 'b2e2b26f-9e8c-4320-a102-9f351883e901', '3a92fa82-2c5d-450c-bc4d-c604ff3ddd67'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:16 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:16 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:17 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.365s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:17 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Deleted volume successfully. Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-523c3357-744d-4f89-8936-310182bbea7a tempest-VolumesActionsTest-252020575 None] Lock "cinder-04dfc304-1b9b-43d9-af78-30c30f005a82-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (6ade671a-d2dd-4af9-be22-fe480846b6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcae491-4898-4027-afe2-c4df59a3ca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcae491-4898-4027-afe2-c4df59a3ca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1270743910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946f9390-923f-4c7e-83cf-c814feb4a3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:18Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e14c8c0-1710-4fef-8f86-e0d480bcb97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e14c8c0-1710-4fef-8f86-e0d480bcb97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546d5900-b22d-4f6a-aada-1b6062e05db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546d5900-b22d-4f6a-aada-1b6062e05db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946f9390-923f-4c7e-83cf-c814feb4a3db', 'volume_name': 'volume-946f9390-923f-4c7e-83cf-c814feb4a3db', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e13087-cc1c-4a2f-af4d-e72bd4e8129a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e13087-cc1c-4a2f-af4d-e72bd4e8129a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611ce0a5-4965-42eb-9055-6ea967cbb9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:17 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Volume 946f9390-923f-4c7e-83cf-c814feb4a3db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946f9390-923f-4c7e-83cf-c814feb4a3db', 'volume_size': 1} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1270743910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946f9390-923f-4c7e-83cf-c814feb4a3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:18Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Creating volume 946f9390-923f-4c7e-83cf-c814feb4a3db {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:17 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:17 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db 1073741824 Nov 04 19:03:17 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:18 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db 1073741824" returned: 0 in 0.629s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b70038d0-de01-45e8-b8e0-3dea46993126 req-11da5c28-766f-418b-8e2f-593cc7d52f66 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:18 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db Nov 04 19:03:18 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:18 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db" returned: 0 in 0.297s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b70038d0-de01-45e8-b8e0-3dea46993126 req-11da5c28-766f-418b-8e2f-593cc7d52f66 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.287s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-b70038d0-de01-45e8-b8e0-3dea46993126 req-11da5c28-766f-418b-8e2f-593cc7d52f66 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611ce0a5-4965-42eb-9055-6ea967cbb9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946f9390-923f-4c7e-83cf-c814feb4a3db', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a733a3bf-5f7d-4e07-9f8f-04dbdda6c2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:18 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Volume volume-946f9390-923f-4c7e-83cf-c814feb4a3db (946f9390-923f-4c7e-83cf-c814feb4a3db): created successfully Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a733a3bf-5f7d-4e07-9f8f-04dbdda6c2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (6ade671a-d2dd-4af9-be22-fe480846b6f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-b70038d0-de01-45e8-b8e0-3dea46993126 req-11da5c28-766f-418b-8e2f-593cc7d52f66 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-cab005ab-9ae9-46ca-9bbe-c9995217f534', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7742d507-b832-427d-839b-b9a5a0584f78', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:03:18 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-deb4914e-fe5a-4373-aff6-029abb8d286b tempest-VolumesActionsTest-1927855345 None] Created volume successfully. Nov 04 19:03:19 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-b70038d0-de01-45e8-b8e0-3dea46993126 req-11da5c28-766f-418b-8e2f-593cc7d52f66 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] attachment_update completed successfully. Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Acquiring lock "cinder-946f9390-923f-4c7e-83cf-c814feb4a3db-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Lock "cinder-946f9390-923f-4c7e-83cf-c814feb4a3db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Acquiring lock "cinder-quobyte-946f9390-923f-4c7e-83cf-c814feb4a3db" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Lock "cinder-quobyte-946f9390-923f-4c7e-83cf-c814feb4a3db" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d0909-63f1-45ea-896e-bd2104f0ed46]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:20 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db Nov 04 19:03:20 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Flow 'volume_create_manager' (82bb8682-686e-46a8-9ed9-855c67927122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b5c0aa-0dda-44f3-b44a-11b0c55bcd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b5c0aa-0dda-44f3-b44a-11b0c55bcd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-274327559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc1189b-815f-49b4-931f-5e8f1c716a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a8fab691748ecbe1e8756b5685260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:21Z,use_quota=True,user_id='ddc8f4696b104a8f94943a5752c2ee89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d0cbd5-317a-4e7c-8654-24e51f06b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d0cbd5-317a-4e7c-8654-24e51f06b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5959ddb-4b1f-4333-9d8b-7d759326fe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5959ddb-4b1f-4333-9d8b-7d759326fe50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc1189b-815f-49b4-931f-5e8f1c716a1d', 'volume_name': 'volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d', 'volume_size': 2}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694ba43e-cb8b-4634-889f-c13ab429d0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694ba43e-cb8b-4634-889f-c13ab429d0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765c497b-a0a5-4f8a-90ab-e3fc88a382a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:20 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Volume 8dc1189b-815f-49b4-931f-5e8f1c716a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d', 'volume_size': 2} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-274327559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc1189b-815f-49b4-931f-5e8f1c716a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1a8fab691748ecbe1e8756b5685260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:21Z,use_quota=True,user_id='ddc8f4696b104a8f94943a5752c2ee89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Creating volume 8dc1189b-815f-49b4-931f-5e8f1c716a1d {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:20 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d 2147483648 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:20 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d 2147483648 Nov 04 19:03:20 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:20 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db" returned: 0 in 0.412s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:20 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db Nov 04 19:03:20 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:21 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-946f9390-923f-4c7e-83cf-c814feb4a3db" returned: 0 in 0.288s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Lock "cinder-quobyte-946f9390-923f-4c7e-83cf-c814feb4a3db" released by "delete_volume" :: held 0.765s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Created reservations ['02dbf9b6-9867-46ba-abb9-d8bd6a44b939', 'b1cab195-0707-40bc-9797-f48b99708314', '1107deab-7b44-47be-a2d3-2dbff2dd319a', 'd41e00ff-2116-4d8d-87ec-3b1348785e6e'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:21 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:21 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:21 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d 2147483648" returned: 0 in 0.561s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:21 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d Nov 04 19:03:21 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:21 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.313s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:21 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Deleted volume successfully. Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3abbf956-4f94-4bc2-9fc3-7e610df76788 tempest-VolumesActionsTest-252020575 None] Lock "cinder-946f9390-923f-4c7e-83cf-c814feb4a3db-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:21 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d" returned: 0 in 0.334s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765c497b-a0a5-4f8a-90ab-e3fc88a382a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d', 'volume_size': 2}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf49d8c6-a7d1-4b2f-9024-27abab750684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:21 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Volume volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d (8dc1189b-815f-49b4-931f-5e8f1c716a1d): created successfully Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf49d8c6-a7d1-4b2f-9024-27abab750684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Flow 'volume_create_manager' (82bb8682-686e-46a8-9ed9-855c67927122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:21 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f4d3de9f-ec55-463d-ae9d-717ac57314c8 tempest-VolumesCloneNegativeTest-2122451872 None] Created volume successfully. Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (82c9dc2d-a849-413a-b142-860ced262a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114cf413-d281-4b57-9f49-a3bb7ed86714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114cf413-d281-4b57-9f49-a3bb7ed86714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1213002713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea67290b-4bae-48b4-ae9c-992a9d96f289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:22Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dd32e7-8eec-4ab7-ae6a-1b14d8b94e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dd32e7-8eec-4ab7-ae6a-1b14d8b94e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f72eb2cf-3765-483f-af46-9f462905d311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f72eb2cf-3765-483f-af46-9f462905d311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea67290b-4bae-48b4-ae9c-992a9d96f289', 'volume_name': 'volume-ea67290b-4bae-48b4-ae9c-992a9d96f289', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ada6ab2-707a-47af-851d-577dee3ff576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ada6ab2-707a-47af-851d-577dee3ff576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7693129-160f-444a-bd8b-09582a3f2949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:22 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Volume ea67290b-4bae-48b4-ae9c-992a9d96f289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea67290b-4bae-48b4-ae9c-992a9d96f289', 'volume_size': 1} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1213002713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea67290b-4bae-48b4-ae9c-992a9d96f289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:22Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Creating volume ea67290b-4bae-48b4-ae9c-992a9d96f289 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:22 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:22 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289 1073741824 Nov 04 19:03:22 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:22 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-2adbb7b9-e690-4cfc-9c7f-e09aa8e742a6 req-dbd8d19b-f647-4a82-a77f-677b5b93cf60 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Terminate volume connection completed successfully. Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-2adbb7b9-e690-4cfc-9c7f-e09aa8e742a6 req-dbd8d19b-f647-4a82-a77f-677b5b93cf60 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Deleting attachment 7742d507-b832-427d-839b-b9a5a0584f78. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:03:22 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289 1073741824" returned: 0 in 0.610s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:22 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289 Nov 04 19:03:22 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Acquiring lock "cinder-8dc1189b-815f-49b4-931f-5e8f1c716a1d-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Lock "cinder-8dc1189b-815f-49b4-931f-5e8f1c716a1d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Acquiring lock "cinder-quobyte-8dc1189b-815f-49b4-931f-5e8f1c716a1d" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Lock "cinder-quobyte-8dc1189b-815f-49b4-931f-5e8f1c716a1d" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:23 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289" returned: 0 in 0.397s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0a4bbd-0248-46fd-abc7-e8300847f926]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7693129-160f-444a-bd8b-09582a3f2949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea67290b-4bae-48b4-ae9c-992a9d96f289', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752eac00-786d-4b87-b8e8-624271d4da8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:23 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Volume volume-ea67290b-4bae-48b4-ae9c-992a9d96f289 (ea67290b-4bae-48b4-ae9c-992a9d96f289): created successfully Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752eac00-786d-4b87-b8e8-624271d4da8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (82c9dc2d-a849-413a-b142-860ced262a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:23 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b626230c-a42a-47e1-9e2f-0cbf71fe2997 tempest-VolumesActionsTest-1927855345 None] Created volume successfully. Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Acquiring lock "cinder-cab005ab-9ae9-46ca-9bbe-c9995217f534-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "cinder-cab005ab-9ae9-46ca-9bbe-c9995217f534-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:23 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d Nov 04 19:03:23 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Acquiring lock "cinder-quobyte-cab005ab-9ae9-46ca-9bbe-c9995217f534" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "cinder-quobyte-cab005ab-9ae9-46ca-9bbe-c9995217f534" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e063509-b06b-45b9-996c-f7970a7bb106]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:23 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534 Nov 04 19:03:23 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:23 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d" returned: 0 in 0.450s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:23 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d Nov 04 19:03:23 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:23 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534" returned: 0 in 0.450s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:23 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8dc1189b-815f-49b4-931f-5e8f1c716a1d" returned: 0 in 0.259s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:23 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534 Nov 04 19:03:23 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Lock "cinder-quobyte-8dc1189b-815f-49b4-931f-5e8f1c716a1d" released by "delete_volume" :: held 0.774s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Created reservations ['04ad80b6-e022-4d23-a4b4-38009cec3f97', '43564c7d-8526-4075-bfc6-0f3c70fe8442', '64530097-90f3-47c7-9ef9-618e6fcb77b9', '2d1b5dbd-4648-4491-bf58-1e9de178c8de'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:24 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:24 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:24 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cab005ab-9ae9-46ca-9bbe-c9995217f534" returned: 0 in 0.276s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "cinder-quobyte-cab005ab-9ae9-46ca-9bbe-c9995217f534" released by "delete_volume" :: held 0.789s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Created reservations ['e7c315f4-a499-4930-ad2f-f043e33a7221', 'aa1435b3-fa7f-484b-9970-08e5120113b8', '0ea7cf49-bfd5-4694-92a3-0f610adfa23d', 'a06e2bee-bdf7-4cfd-ba73-ba1ec5031e7a'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Acquiring lock "cinder-ea67290b-4bae-48b4-ae9c-992a9d96f289-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:24 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Lock "cinder-ea67290b-4bae-48b4-ae9c-992a9d96f289-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.342s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Deleted volume successfully. Nov 04 19:03:24 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:24 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50fadee6-3db8-45da-ad4c-5c1c184c7b29 tempest-VolumesCloneNegativeTest-2122451872 None] Lock "cinder-8dc1189b-815f-49b4-931f-5e8f1c716a1d-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Acquiring lock "cinder-quobyte-ea67290b-4bae-48b4-ae9c-992a9d96f289" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Lock "cinder-quobyte-ea67290b-4bae-48b4-ae9c-992a9d96f289" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e9bbf-03cf-41d3-98a6-8dca9cf170c3]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:24 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289 Nov 04 19:03:24 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:24 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.370s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Deleted volume successfully. Nov 04 19:03:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9e4e8f82-2976-41ca-912e-394869eeb1c5 tempest-TestServerVolumeAttachScenarioOldVersion-1865632030 None] Lock "cinder-cab005ab-9ae9-46ca-9bbe-c9995217f534-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:25 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289" returned: 0 in 0.688s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:25 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289 Nov 04 19:03:25 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:25 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea67290b-4bae-48b4-ae9c-992a9d96f289" returned: 0 in 0.332s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Lock "cinder-quobyte-ea67290b-4bae-48b4-ae9c-992a9d96f289" released by "delete_volume" :: held 1.092s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:25 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Created reservations ['7a6bd7b2-7f1c-47b0-80ab-dca783dcabc8', 'b7281fb3-ed77-4778-a6f1-de67a9ab610b', 'b09abd9e-9a40-4daa-9203-8e77c54dfd74', '15b629e5-3558-4ce9-a64a-35cfed37ba04'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:25 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:25 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:26 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.325s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:26 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:26 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Deleted volume successfully. Nov 04 19:03:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9a495e72-78f0-47b0-9b8b-a242eec48563 tempest-VolumesActionsTest-252020575 None] Lock "cinder-ea67290b-4bae-48b4-ae9c-992a9d96f289-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (9b6cd494-2735-442f-b7cc-8a978b7166ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbafe49-8f64-42da-a457-0cd9f02e7b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbafe49-8f64-42da-a457-0cd9f02e7b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1139798375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dceb1051-8b9f-4897-bb6c-a214d330fabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:27Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04897302-1456-4df0-bc56-d88e311fef94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04897302-1456-4df0-bc56-d88e311fef94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1661a40b-d60a-43c2-83b7-ea668f1622e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1661a40b-d60a-43c2-83b7-ea668f1622e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dceb1051-8b9f-4897-bb6c-a214d330fabf', 'volume_name': 'volume-dceb1051-8b9f-4897-bb6c-a214d330fabf', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679cc5c6-831c-4abd-95d5-aab396550baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679cc5c6-831c-4abd-95d5-aab396550baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5673723b-0e41-4952-b746-f05eb2c34446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:27 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Volume dceb1051-8b9f-4897-bb6c-a214d330fabf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dceb1051-8b9f-4897-bb6c-a214d330fabf', 'volume_size': 1} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1139798375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dceb1051-8b9f-4897-bb6c-a214d330fabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbe4245daef47dbb9a9d76c0f56851a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:27Z,use_quota=True,user_id='7984c33098754ba3a8a0d915adc1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Creating volume dceb1051-8b9f-4897-bb6c-a214d330fabf {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:27 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:27 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf 1073741824 Nov 04 19:03:27 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:27 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf 1073741824" returned: 0 in 0.481s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:28 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf Nov 04 19:03:28 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:28 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf" returned: 0 in 0.331s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5673723b-0e41-4952-b746-f05eb2c34446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dceb1051-8b9f-4897-bb6c-a214d330fabf', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2847433-afb6-48b1-926d-1fdd8d634dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:28 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Volume volume-dceb1051-8b9f-4897-bb6c-a214d330fabf (dceb1051-8b9f-4897-bb6c-a214d330fabf): created successfully Nov 04 19:03:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2847433-afb6-48b1-926d-1fdd8d634dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Flow 'volume_create_manager' (9b6cd494-2735-442f-b7cc-8a978b7166ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:28 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-30ed9e8b-2365-4dbc-a907-929d974c0ea9 tempest-VolumesActionsTest-1927855345 None] Created volume successfully. Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (d550e7ab-ab5b-45a3-89cf-b91201106a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173cce27-dbfd-495c-b653-0de9772ac095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173cce27-dbfd-495c-b653-0de9772ac095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-936729730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2e566d-0dc3-48f6-abcb-8883e3213e29,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:30Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101c7fb7-f7ae-49c3-9418-b3166ada48d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101c7fb7-f7ae-49c3-9418-b3166ada48d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34101b3f-b0b7-4834-b3ed-ee15067257a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34101b3f-b0b7-4834-b3ed-ee15067257a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c2e566d-0dc3-48f6-abcb-8883e3213e29', 'volume_name': 'volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c652cfb6-106d-4543-b928-7435ec7cff43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c652cfb6-106d-4543-b928-7435ec7cff43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b5e6f3-ba3f-4b2a-ada3-6673980e1837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:29 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Volume 3c2e566d-0dc3-48f6-abcb-8883e3213e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29', 'volume_size': 1} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-936729730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2e566d-0dc3-48f6-abcb-8883e3213e29,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:30Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Creating volume 3c2e566d-0dc3-48f6-abcb-8883e3213e29 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:29 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:29 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29 1073741824 Nov 04 19:03:29 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "cinder-dceb1051-8b9f-4897-bb6c-a214d330fabf-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Lock "cinder-dceb1051-8b9f-4897-bb6c-a214d330fabf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "cinder-quobyte-dceb1051-8b9f-4897-bb6c-a214d330fabf" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Lock "cinder-quobyte-dceb1051-8b9f-4897-bb6c-a214d330fabf" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32701a4-ec53-47a2-b3c9-0c0c6cd8e848]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:30 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf Nov 04 19:03:30 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:30 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29 1073741824" returned: 0 in 0.576s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:30 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29 Nov 04 19:03:30 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:30 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf" returned: 0 in 0.466s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:30 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf Nov 04 19:03:30 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:30 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29" returned: 0 in 0.318s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b5e6f3-ba3f-4b2a-ada3-6673980e1837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca75d5c-8bf9-4b5f-acd7-ffaeeb12fbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:30 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Volume volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29 (3c2e566d-0dc3-48f6-abcb-8883e3213e29): created successfully Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca75d5c-8bf9-4b5f-acd7-ffaeeb12fbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (d550e7ab-ab5b-45a3-89cf-b91201106a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:30 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-25cf0762-2b7a-44aa-a281-ea7ecb14350c tempest-VolumesGetTest-142130618 None] Created volume successfully. Nov 04 19:03:31 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dceb1051-8b9f-4897-bb6c-a214d330fabf" returned: 0 in 0.285s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Lock "cinder-quobyte-dceb1051-8b9f-4897-bb6c-a214d330fabf" released by "delete_volume" :: held 0.834s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Created reservations ['1af766cb-d1f4-4d1e-aa4b-5a7d7c90bfc7', 'fa8786a4-df6f-4a98-b4cd-6e99498de8f1', '8a4906c4-a11d-46b0-8cc8-5144a9df074d', 'f4e2992e-57d0-4325-a22c-009455f3e35f'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:31 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:31 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:31 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.314s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:31 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Deleted volume successfully. Nov 04 19:03:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a2661b6-0683-48de-b53a-f855cc961cd2 tempest-VolumesActionsTest-1927855345 None] Lock "cinder-dceb1051-8b9f-4897-bb6c-a214d330fabf-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:32 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (6c09e901-a2b1-4a01-92a9-008925da184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58970c0f-0767-4207-9166-736264461617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58970c0f-0767-4207-9166-736264461617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-279028353',display_name='tempest-VolumesGetTest-Volume-1437224567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d35e69-bd85-467a-af50-e4646a192662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:33Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ef3ef5-c6e8-4c7c-b585-ca85b866f9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ef3ef5-c6e8-4c7c-b585-ca85b866f9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed697e0e-69ef-45cb-93fb-a141b0cc29e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed697e0e-69ef-45cb-93fb-a141b0cc29e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12d35e69-bd85-467a-af50-e4646a192662', 'volume_name': 'volume-12d35e69-bd85-467a-af50-e4646a192662', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed433911-7359-44c9-8e1f-9ecfaef2d94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed433911-7359-44c9-8e1f-9ecfaef2d94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4018bf0d-6f47-4253-89e7-8a7da60c6bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:33 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Volume 12d35e69-bd85-467a-af50-e4646a192662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12d35e69-bd85-467a-af50-e4646a192662', 'volume_size': 1} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-279028353',display_name='tempest-VolumesGetTest-Volume-1437224567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d35e69-bd85-467a-af50-e4646a192662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:33Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Creating volume 12d35e69-bd85-467a-af50-e4646a192662 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:33 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:33 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662 1073741824 Nov 04 19:03:33 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:33 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662 1073741824" returned: 0 in 0.596s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:33 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662 Nov 04 19:03:33 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:34 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4018bf0d-6f47-4253-89e7-8a7da60c6bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d35e69-bd85-467a-af50-e4646a192662', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987df799-6846-4db2-aaf1-093869e9abdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:34 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Volume volume-12d35e69-bd85-467a-af50-e4646a192662 (12d35e69-bd85-467a-af50-e4646a192662): created successfully Nov 04 19:03:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987df799-6846-4db2-aaf1-093869e9abdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (6c09e901-a2b1-4a01-92a9-008925da184e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:34 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1b7c31d0-cd6f-4fdd-8f94-54d50c758847 tempest-VolumesGetTest-142130618 None] Created volume successfully. Nov 04 19:03:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-12d35e69-bd85-467a-af50-e4646a192662-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Lock "cinder-12d35e69-bd85-467a-af50-e4646a192662-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-quobyte-12d35e69-bd85-467a-af50-e4646a192662" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-12d35e69-bd85-467a-af50-e4646a192662" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:35 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fac5a5-694e-453a-9947-db67ed24501b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:35 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662 Nov 04 19:03:35 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:35 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662" returned: 0 in 0.525s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:35 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662 Nov 04 19:03:35 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:36 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-12d35e69-bd85-467a-af50-e4646a192662" returned: 0 in 0.299s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-12d35e69-bd85-467a-af50-e4646a192662" released by "delete_volume" :: held 0.891s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Created reservations ['b3c7a0e9-3c85-48cd-aa03-4e949f2d8eef', '39ceee27-e1dd-428b-9e19-46107b368ab3', '7a7992d5-d41e-425f-8a3d-c35b86761552', '50e95322-d53b-4014-a6d3-0f4f77e4bc3c'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:36 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:36 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-3c2e566d-0dc3-48f6-abcb-8883e3213e29-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Lock "cinder-3c2e566d-0dc3-48f6-abcb-8883e3213e29-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-quobyte-3c2e566d-0dc3-48f6-abcb-8883e3213e29" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-3c2e566d-0dc3-48f6-abcb-8883e3213e29" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5be4ab6-9c7f-459d-a0d6-aa97b1a7d59d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:36 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.472s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Deleted volume successfully. Nov 04 19:03:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7d2009e8-1716-45af-a3a5-a1ab90c02dd9 tempest-VolumesGetTest-142130618 None] Lock "cinder-12d35e69-bd85-467a-af50-e4646a192662-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:36 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29 Nov 04 19:03:36 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:37 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29" returned: 0 in 0.484s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:37 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29 Nov 04 19:03:37 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:37 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3c2e566d-0dc3-48f6-abcb-8883e3213e29" returned: 0 in 0.272s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-3c2e566d-0dc3-48f6-abcb-8883e3213e29" released by "delete_volume" :: held 0.823s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:37 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Created reservations ['0f4e7d7a-de1a-4e28-9002-391d4d689bba', '7787f049-74d4-44a9-b70b-18ab4d355a0c', 'd7f81189-e179-43dc-804d-194129440005', '7ee7de6c-cd06-495d-adf9-d2f0efa46cf9'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:03:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:37 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:03:37 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:38 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.369s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:03:38 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Deleted volume successfully. Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6cf220c4-05e2-4d61-b812-19635adde972 tempest-VolumesGetTest-142130618 None] Lock "cinder-3c2e566d-0dc3-48f6-abcb-8883e3213e29-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (f88795cb-f427-48dd-a567-8987b5fd97c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cf2cb4-4da8-49ba-ac79-1cf254ed2ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cf2cb4-4da8-49ba-ac79-1cf254ed2ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-319919742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac21be41-94da-4d50-9885-5138a53d9049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:38Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63f6aba-cc7b-4bbb-9141-c587996dce75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63f6aba-cc7b-4bbb-9141-c587996dce75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c10b87-c5b4-4b9d-b893-61cc37fc3592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c10b87-c5b4-4b9d-b893-61cc37fc3592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac21be41-94da-4d50-9885-5138a53d9049', 'volume_name': 'volume-ac21be41-94da-4d50-9885-5138a53d9049', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373cd719-23d7-4380-8d4c-fac62f5dcde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373cd719-23d7-4380-8d4c-fac62f5dcde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638eef64-a5b0-436e-ac99-6d9d084c1f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:38 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Volume ac21be41-94da-4d50-9885-5138a53d9049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac21be41-94da-4d50-9885-5138a53d9049', 'volume_size': 1} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-319919742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac21be41-94da-4d50-9885-5138a53d9049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:38Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Creating volume ac21be41-94da-4d50-9885-5138a53d9049 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:38 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:38 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 1073741824 Nov 04 19:03:38 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:39 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 1073741824" returned: 0 in 0.554s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:39 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 Nov 04 19:03:39 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:39 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049" returned: 0 in 0.358s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638eef64-a5b0-436e-ac99-6d9d084c1f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac21be41-94da-4d50-9885-5138a53d9049', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79294d1e-380c-4e52-8eff-d846ed760ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:39 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Volume volume-ac21be41-94da-4d50-9885-5138a53d9049 (ac21be41-94da-4d50-9885-5138a53d9049): created successfully Nov 04 19:03:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79294d1e-380c-4e52-8eff-d846ed760ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (f88795cb-f427-48dd-a567-8987b5fd97c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:39 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-68894488-f697-4fcc-92d5-8b1df8fd106d tempest-VolumesGetTest-142130618 None] Created volume successfully. Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (47d7ee3d-cd0c-4852-8a33-51e1f1cb7e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fde37b2-68ec-400f-a466-d6e6589b60b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fde37b2-68ec-400f-a466-d6e6589b60b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1145265942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13fa451-5521-44ea-8876-ab416f43f9ca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ac21be41-94da-4d50-9885-5138a53d9049,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:41Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ce590d-7cba-436b-8abc-956ca3d1817e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ce590d-7cba-436b-8abc-956ca3d1817e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed92704-f6a0-4d1e-a32c-5d3326688ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed92704-f6a0-4d1e-a32c-5d3326688ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b13fa451-5521-44ea-8876-ab416f43f9ca', 'volume_name': 'volume-b13fa451-5521-44ea-8876-ab416f43f9ca', 'volume_size': 1, 'source_volid': 'ac21be41-94da-4d50-9885-5138a53d9049', 'source_volstatus': 'available'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19b008a-59af-448d-aca3-6544c3d3d8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19b008a-59af-448d-aca3-6544c3d3d8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb25765-ce69-4f40-b8b0-7fed83a0c1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:41 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Volume b13fa451-5521-44ea-8876-ab416f43f9ca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b13fa451-5521-44ea-8876-ab416f43f9ca', 'volume_size': 1, 'source_volid': 'ac21be41-94da-4d50-9885-5138a53d9049', 'source_volstatus': 'available'} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:41 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Cloning volume ac21be41-94da-4d50-9885-5138a53d9049 to volume b13fa451-5521-44ea-8876-ab416f43f9ca Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Creating offline snapshot 79f3885e-0581-467b-8452-1d63300086cd of volume ac21be41-94da-4d50-9885-5138a53d9049 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[71317499-0c1c-4ac6-b4a6-1b30504e346b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:41 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 Nov 04 19:03:41 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:41 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049" returned: 0 in 0.492s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:41 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd 1G Nov 04 19:03:41 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:42 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd 1G" returned: 0 in 0.599s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac21be41-94da-4d50-9885-5138a53d9049 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:42 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac21be41-94da-4d50-9885-5138a53d9049 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd Nov 04 19:03:42 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:42 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac21be41-94da-4d50-9885-5138a53d9049 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd" returned: 0 in 0.441s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:42 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd is being set with open permissions: ugo+rw Nov 04 19:03:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:43 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd Nov 04 19:03:43 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:43 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd" returned: 0 in 0.357s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:43 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.info Nov 04 19:03:43 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:43 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.info" returned: 0 in 0.326s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:43 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.info is being set with open permissions: ugo+rw Nov 04 19:03:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:43 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.info Nov 04 19:03:43 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:44 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.info" returned: 0 in 0.302s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-quobyte-b13fa451-5521-44ea-8876-ab416f43f9ca" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-b13fa451-5521-44ea-8876-ab416f43f9ca" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] snapshot: 79f3885e-0581-467b-8452-1d63300086cd, volume: b13fa451-5521-44ea-8876-ab416f43f9ca, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a41e69a-a9ec-4ee8-a4b8-eafcb37c0c2e]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:44 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd Nov 04 19:03:44 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:44 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd" returned: 0 in 0.492s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac21be41-94da-4d50-9885-5138a53d9049(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6e7ee4-4b9e-49ed-ab3c-8d31e6e0b574]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:44 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 Nov 04 19:03:44 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:45 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049" returned: 0 in 0.474s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:45 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:03:45 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:03:45 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:03:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:45 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca Nov 04 19:03:45 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:53 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=123,cinder:UPDATE=163,cinder:INSERT=32,cinder:DELETE=15 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:03:53 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=116,cinder:UPDATE=164,cinder:INSERT=43,cinder:DELETE=14 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:03:53 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca" returned: 0 in 8.633s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:53 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:03:53 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Converted 1024.00 MB image at 118.60 MB/s Nov 04 19:03:53 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca is being set with open permissions: ugo+rw Nov 04 19:03:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:53 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca Nov 04 19:03:53 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:54 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca" returned: 0 in 0.284s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-b13fa451-5521-44ea-8876-ab416f43f9ca" released by "_copy_volume_from_snapshot" :: held 10.008s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-quobyte-79f3885e-0581-467b-8452-1d63300086cd" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-79f3885e-0581-467b-8452-1d63300086cd" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Deleting offline snapshot 79f3885e-0581-467b-8452-1d63300086cd of volume ac21be41-94da-4d50-9885-5138a53d9049 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] snapshot_file for this snap is: volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c4127b-f0e8-402d-b9db-146bde267718]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:54 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd Nov 04 19:03:54 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:54 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd" returned: 0 in 0.404s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac21be41-94da-4d50-9885-5138a53d9049(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb68c5ea-c878-41f9-a327-d4fc2f389d14]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:54 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 Nov 04 19:03:54 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:55 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049" returned: 0 in 0.723s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:55 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd Nov 04 19:03:55 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:55 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd" returned: 0 in 0.471s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:55 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd Nov 04 19:03:55 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Flow 'volume_create_manager' (aa649637-7e7f-4dba-aa88-b4cb0a1af791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060125b0-2a31-4029-b9ed-74a8d307c700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060125b0-2a31-4029-b9ed-74a8d307c700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1553430542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b5b282-4d09-4d24-b8b0-68917fa05c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d3314b903c47fb82f1db978d97dbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:56Z,use_quota=True,user_id='58efd6200f92482094b3f46419e83336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d32a49-dd02-44e3-b447-ff03df05151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d32a49-dd02-44e3-b447-ff03df05151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6bc242-3b76-4a6c-8b81-a3dbd57f715a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6bc242-3b76-4a6c-8b81-a3dbd57f715a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b5b282-4d09-4d24-b8b0-68917fa05c39', 'volume_name': 'volume-87b5b282-4d09-4d24-b8b0-68917fa05c39', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:56 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2d6d60-a522-4dc6-b9df-096426a77e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2d6d60-a522-4dc6-b9df-096426a77e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a720d270-6d9e-464e-8811-00805a17c495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:56 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Volume 87b5b282-4d09-4d24-b8b0-68917fa05c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b5b282-4d09-4d24-b8b0-68917fa05c39', 'volume_size': 1} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049.79f3885e-0581-467b-8452-1d63300086cd" returned: 0 in 0.477s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-79f3885e-0581-467b-8452-1d63300086cd" released by "_delete_snapshot" :: held 2.262s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.061s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.084s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1553430542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b5b282-4d09-4d24-b8b0-68917fa05c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d3314b903c47fb82f1db978d97dbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:56Z,use_quota=True,user_id='58efd6200f92482094b3f46419e83336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Creating volume 87b5b282-4d09-4d24-b8b0-68917fa05c39 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:56 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:56 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 1073741824 Nov 04 19:03:56 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb25765-ce69-4f40-b8b0-7fed83a0c1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13fa451-5521-44ea-8876-ab416f43f9ca', 'volume_size': 1, 'source_volid': 'ac21be41-94da-4d50-9885-5138a53d9049', 'source_volstatus': 'available'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f024916d-e279-4c84-b7e8-ceabce81e67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:56 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Volume volume-b13fa451-5521-44ea-8876-ab416f43f9ca (b13fa451-5521-44ea-8876-ab416f43f9ca): created successfully Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f024916d-e279-4c84-b7e8-ceabce81e67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (47d7ee3d-cd0c-4852-8a33-51e1f1cb7e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:56 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-17a9923b-a925-4166-acc6-a34441e774b8 tempest-VolumesGetTest-142130618 None] Created volume successfully. Nov 04 19:03:57 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 1073741824" returned: 0 in 0.607s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:57 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 Nov 04 19:03:57 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:57 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39" returned: 0 in 0.417s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a720d270-6d9e-464e-8811-00805a17c495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b5b282-4d09-4d24-b8b0-68917fa05c39', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e87769-83ee-4095-b3a2-d75afb2da0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:57 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Volume volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 (87b5b282-4d09-4d24-b8b0-68917fa05c39): created successfully Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e87769-83ee-4095-b3a2-d75afb2da0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Flow 'volume_create_manager' (aa649637-7e7f-4dba-aa88-b4cb0a1af791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-509b0297-c41f-4fee-9b02-6d8ebaf4f610 tempest-SnapshotMetadataTestJSON-1493998633 None] Created volume successfully. Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (7b373a01-bb2a-4144-90e7-09de7e821640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e995f5-b747-4381-8d4c-3975a2f1be2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e995f5-b747-4381-8d4c-3975a2f1be2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-525115917',display_name='tempest-VolumesGetTest-Volume-1140338160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fd1e96-cf91-4fa8-b08e-497be5b783fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:58Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45f1d0e-b920-4548-9834-77cf00034d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45f1d0e-b920-4548-9834-77cf00034d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979cbc35-e269-421e-9623-cc86d4e82df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979cbc35-e269-421e-9623-cc86d4e82df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fd1e96-cf91-4fa8-b08e-497be5b783fd', 'volume_name': 'volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3b168c-a982-4a2e-83a7-b7602982bdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3b168c-a982-4a2e-83a7-b7602982bdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c675dc2-94d6-47be-b688-bb73b19b51d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:57 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Volume 30fd1e96-cf91-4fa8-b08e-497be5b783fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd', 'volume_size': 1} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:03:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-525115917',display_name='tempest-VolumesGetTest-Volume-1140338160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fd1e96-cf91-4fa8-b08e-497be5b783fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:03:58Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Creating volume 30fd1e96-cf91-4fa8-b08e-497be5b783fd {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:03:57 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:03:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:57 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd 1073741824 Nov 04 19:03:57 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:58 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd 1073741824" returned: 0 in 0.606s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:58 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd Nov 04 19:03:58 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:58 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd" returned: 0 in 0.288s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.300s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c675dc2-94d6-47be-b688-bb73b19b51d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb78936-b4a7-43a6-aae5-cceb7f41e095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] Creating offline snapshot e233cef1-b1b2-4d11-8911-a15f94a0dcde of volume 87b5b282-4d09-4d24-b8b0-68917fa05c39 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:03:58 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Volume volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd (30fd1e96-cf91-4fa8-b08e-497be5b783fd): created successfully Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb78936-b4a7-43a6-aae5-cceb7f41e095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (7b373a01-bb2a-4144-90e7-09de7e821640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6464e543-e6b9-4e8d-bbf3-458416d9a8a4]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:03:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:58 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-fa110244-b72d-40d8-a4d9-2e88ba5cace5 tempest-VolumesGetTest-142130618 None] Created volume successfully. Nov 04 19:03:59 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 Nov 04 19:03:59 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:59 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39" returned: 0 in 0.441s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:59 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde 1G Nov 04 19:03:59 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:03:59 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Nov 04 19:03:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde 1G" returned: 0 in 0.486s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:03:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:03:59 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde Nov 04 19:03:59 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-30fd1e96-cf91-4fa8-b08e-497be5b783fd-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Lock "cinder-30fd1e96-cf91-4fa8-b08e-497be5b783fd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-quobyte-30fd1e96-cf91-4fa8-b08e-497be5b783fd" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:00 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-30fd1e96-cf91-4fa8-b08e-497be5b783fd" acquired by "delete_volume" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde" returned: 0 in 0.398s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:00 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde is being set with open permissions: ugo+rw Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1df926-1a47-4d8e-8507-b96462dceddb]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:00 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde Nov 04 19:04:00 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:00 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd Nov 04 19:04:00 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:00 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde" returned: 0 in 0.386s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:00 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.info Nov 04 19:04:00 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:00 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd" returned: 0 in 0.518s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:00 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd Nov 04 19:04:00 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:00 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.info" returned: 0 in 0.287s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:01 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.info is being set with open permissions: ugo+rw Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:01 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.info Nov 04 19:04:01 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:01 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-30fd1e96-cf91-4fa8-b08e-497be5b783fd" returned: 0 in 0.299s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-30fd1e96-cf91-4fa8-b08e-497be5b783fd" released by "delete_volume" :: held 0.890s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Created reservations ['37da2970-40e0-4afa-9603-70df7ca64295', '13a96f06-fbc5-4699-881a-42abb2fc66bb', '5133357f-ef6b-4bbe-bcd4-804c2cfd6b45', '6d61f642-791e-436e-bfb0-7cf9ffcd663d'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:01 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.info" returned: 0 in 0.356s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:01 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:01 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-37090ee6-4896-462c-9c81-9d14f773fcfd tempest-SnapshotMetadataTestJSON-1493998633 None] Create snapshot completed successfully Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-b13fa451-5521-44ea-8876-ab416f43f9ca-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Lock "cinder-b13fa451-5521-44ea-8876-ab416f43f9ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-quobyte-b13fa451-5521-44ea-8876-ab416f43f9ca" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-b13fa451-5521-44ea-8876-ab416f43f9ca" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:01 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3d2b39-878b-4e61-9636-ba2e614af572]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.387s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Deleted volume successfully. Nov 04 19:04:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-723cc909-f92c-4a42-813b-a91cc3bc501c tempest-VolumesGetTest-142130618 None] Lock "cinder-30fd1e96-cf91-4fa8-b08e-497be5b783fd-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:01 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca Nov 04 19:04:01 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:02 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca" returned: 0 in 0.500s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:02 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca Nov 04 19:04:02 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:02 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b13fa451-5521-44ea-8876-ab416f43f9ca" returned: 0 in 0.413s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-b13fa451-5521-44ea-8876-ab416f43f9ca" released by "delete_volume" :: held 1.005s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:02 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Created reservations ['9d490c87-fdf3-485e-8b1a-f2920d0484e7', 'c6010b6d-abc6-41b6-a6d7-c43f26371b39', 'a30ed119-33f0-4d3b-be42-51503c94baa0', 'a9f0637e-d42f-4e75-893d-d5eb39380c66'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:02 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:02 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Acquiring lock "cinder-e233cef1-b1b2-4d11-8911-a15f94a0dcde-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "cinder-e233cef1-b1b2-4d11-8911-a15f94a0dcde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Acquiring lock "cinder-quobyte-87b5b282-4d09-4d24-b8b0-68917fa05c39" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "cinder-quobyte-87b5b282-4d09-4d24-b8b0-68917fa05c39" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Acquiring lock "cinder-quobyte-e233cef1-b1b2-4d11-8911-a15f94a0dcde" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:03 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.359s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "cinder-quobyte-e233cef1-b1b2-4d11-8911-a15f94a0dcde" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Deleting offline snapshot e233cef1-b1b2-4d11-8911-a15f94a0dcde of volume 87b5b282-4d09-4d24-b8b0-68917fa05c39 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] snapshot_file for this snap is: volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:03 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Deleted volume successfully. Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1597c835-c1df-45e9-a296-05094daf9fc9]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1972448d-fbfd-41b3-8bcf-d50ae5f3aed9 tempest-VolumesGetTest-142130618 None] Lock "cinder-b13fa451-5521-44ea-8876-ab416f43f9ca-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:03 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde Nov 04 19:04:03 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:03 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde" returned: 0 in 0.421s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87b5b282-4d09-4d24-b8b0-68917fa05c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbce9d4-7d71-4dfd-9164-833cab18d59d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:03 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 Nov 04 19:04:03 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-ac21be41-94da-4d50-9885-5138a53d9049-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Lock "cinder-ac21be41-94da-4d50-9885-5138a53d9049-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-quobyte-ac21be41-94da-4d50-9885-5138a53d9049" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-ac21be41-94da-4d50-9885-5138a53d9049" acquired by "delete_volume" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46f5910-5740-41c3-8db4-2f55ba64d69c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:04 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 Nov 04 19:04:04 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:04 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39" returned: 0 in 0.552s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:04 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde Nov 04 19:04:04 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:04 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049" returned: 0 in 0.488s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:04 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049 Nov 04 19:04:04 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:04 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde" returned: 0 in 0.418s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:04 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde Nov 04 19:04:04 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:04 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac21be41-94da-4d50-9885-5138a53d9049" returned: 0 in 0.319s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-ac21be41-94da-4d50-9885-5138a53d9049" released by "delete_volume" :: held 0.895s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Created reservations ['08cc1259-1bf9-455e-b996-293796444e79', '8ed271bc-8f3b-4e5c-8b41-01080f53fab1', '79ab5f9b-0c96-4794-95d5-63ffd4baffb1', 'c90c253d-15cd-4f02-afcb-5822d373cad8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:04 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39.e233cef1-b1b2-4d11-8911-a15f94a0dcde" returned: 0 in 0.297s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "cinder-quobyte-e233cef1-b1b2-4d11-8911-a15f94a0dcde" released by "_delete_snapshot" :: held 1.859s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "cinder-quobyte-87b5b282-4d09-4d24-b8b0-68917fa05c39" released by "delete_snapshot" :: held 1.908s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:05 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:05 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Created reservations ['a89a9f36-a8ec-4c11-89ae-d897d189dd79', '44128973-1f19-4d9b-9874-76f0a3c31da6', '7c003cd6-b4ac-499e-82ed-4671d2ce23da', '79b530c8-fcfd-46fe-8031-04f4392b0eec'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Delete snapshot completed successfully. Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-001ea12c-e16f-4f64-86a6-7940775b09b3 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "cinder-e233cef1-b1b2-4d11-8911-a15f94a0dcde-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:05 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.357s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Deleted volume successfully. Nov 04 19:04:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb615461-cee7-4eaf-9a05-6441be0dec80 tempest-VolumesGetTest-142130618 None] Lock "cinder-ac21be41-94da-4d50-9885-5138a53d9049-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (a54aba78-e0d6-4d91-a910-7489190f9f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45233f3-5eb1-4f51-9f76-dff896671419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45233f3-5eb1-4f51-9f76-dff896671419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1492288553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10860568-b994-447a-8ed2-bbd5218d2b92,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:06Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d364f86-8a8c-4906-900d-1a9e28685017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d364f86-8a8c-4906-900d-1a9e28685017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7329e871-9841-4864-a40b-fc1c4e0be10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.image.glance [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Creating Keystone auth plugin from conf {{(pid=87364) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Acquiring lock "cinder-87b5b282-4d09-4d24-b8b0-68917fa05c39-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "cinder-87b5b282-4d09-4d24-b8b0-68917fa05c39-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Acquiring lock "cinder-quobyte-87b5b282-4d09-4d24-b8b0-68917fa05c39" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7329e871-9841-4864-a40b-fc1c4e0be10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10860568-b994-447a-8ed2-bbd5218d2b92', 'volume_name': 'volume-10860568-b994-447a-8ed2-bbd5218d2b92', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ceb9626-c6ba-443c-a2d7-61d9d8cb1038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ceb9626-c6ba-443c-a2d7-61d9d8cb1038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94953277-24ec-443c-aaef-d227e8b646dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:06 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Volume 10860568-b994-447a-8ed2-bbd5218d2b92: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10860568-b994-447a-8ed2-bbd5218d2b92', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Trying to clone 10860568-b994-447a-8ed2-bbd5218d2b92 from image 49906b66-c86b-4e49-9cb0-47d303080f8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]). {{(pid=87364) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "cinder-quobyte-87b5b282-4d09-4d24-b8b0-68917fa05c39" acquired by "delete_volume" :: waited 0.047s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[348ee5c4-35ed-4b3c-831e-c835f6cf8124]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:06 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 Nov 04 19:04:06 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:06 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:04:06 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Image download 20.69 MB at 20.69 MB/s Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b90460-4f99-40fe-8717-0b0e4fb1ea49]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:07 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39" returned: 0 in 0.463s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:07 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39 Nov 04 19:04:07 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:07 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD Nov 04 19:04:07 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:07 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87b5b282-4d09-4d24-b8b0-68917fa05c39" returned: 0 in 0.407s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "cinder-quobyte-87b5b282-4d09-4d24-b8b0-68917fa05c39" released by "delete_volume" :: held 0.963s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:07 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD" returned: 0 in 0.527s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Temporary image 49906b66-c86b-4e49-9cb0-47d303080f8f is fetched for user 4d1072c6bec14f7494960f00a2cb1b78. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Created reservations ['0fa53341-2de6-4125-9b54-6f596ba3e4e9', 'f4eddde6-17fe-4d31-8036-83b3cc2fa320', '7269f2b5-402b-4bc7-9143-a4d840163941', 'ab720cce-7748-48ff-b5ad-1d7a554e40e3'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7a2c14-f7e9-48a0-9ef9-de198953e501]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:07 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:07 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:07 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD Nov 04 19:04:07 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:08 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1492288553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10860568-b994-447a-8ed2-bbd5218d2b92,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:06Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Creating volume 10860568-b994-447a-8ed2-bbd5218d2b92 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:08 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:08 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.313s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:08 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Deleted volume successfully. Nov 04 19:04:08 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 1073741824 Nov 04 19:04:08 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e2c3bdd4-0c2b-475c-8bc4-102e3a96cf37 tempest-SnapshotMetadataTestJSON-1493998633 None] Lock "cinder-87b5b282-4d09-4d24-b8b0-68917fa05c39-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:08 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 1073741824" returned: 0 in 0.548s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:08 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 Nov 04 19:04:08 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:08 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92" returned: 0 in 0.303s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:08 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Attempting download of 49906b66-c86b-4e49-9cb0-47d303080f8f ((None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}])) to volume 10860568-b994-447a-8ed2-bbd5218d2b92. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:04:09 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc750b93-d964-44cd-8e40-24fda6442fba]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_ba4z6o97 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:09 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_ba4z6o97 Nov 04 19:04:09 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:09 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_ba4z6o97" returned: 0 in 0.434s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_ba4z6o97 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:09 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_ba4z6o97 Nov 04 19:04:09 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:09 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_ba4z6o97" returned: 1 in 0.442s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_ba4z6o97' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:04:09 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[65619be6-2dc5-400c-81c5-52d1b70b5441]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:10 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD Nov 04 19:04:10 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:10 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:10 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] 49906b66-c86b-4e49-9cb0-47d303080f8f was qcow2, converting to qcow2 {{(pid=87364) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:04:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:10 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 Nov 04 19:04:10 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:12 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92" returned: 0 in 2.540s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:12 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_ijjopjh9devstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:04:12 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Converted 112.00 MB image at 44.07 MB/s Nov 04 19:04:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:12 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 1G Nov 04 19:04:12 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:13 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 1G" returned: 0 in 0.477s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Downloaded image 49906b66-c86b-4e49-9cb0-47d303080f8f ((None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}])) to volume 10860568-b994-447a-8ed2-bbd5218d2b92 successfully. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Temporary image 49906b66-c86b-4e49-9cb0-47d303080f8f for user 4d1072c6bec14f7494960f00a2cb1b78 is deleted. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Marking volume 10860568-b994-447a-8ed2-bbd5218d2b92 as bootable. {{(pid=87364) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Copying metadata from image 49906b66-c86b-4e49-9cb0-47d303080f8f to 10860568-b994-447a-8ed2-bbd5218d2b92. {{(pid=87364) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Creating volume glance metadata for volume 10860568-b994-447a-8ed2-bbd5218d2b92 backed by image 49906b66-c86b-4e49-9cb0-47d303080f8f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87364) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94953277-24ec-443c-aaef-d227e8b646dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10860568-b994-447a-8ed2-bbd5218d2b92', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757970a5-67aa-4eba-bf3b-c8690b3d5635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:13 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Volume volume-10860568-b994-447a-8ed2-bbd5218d2b92 (10860568-b994-447a-8ed2-bbd5218d2b92): created successfully Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757970a5-67aa-4eba-bf3b-c8690b3d5635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (a54aba78-e0d6-4d91-a910-7489190f9f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:13 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-89e3a324-d079-4225-ac90-d22047fb835a tempest-VolumesGetTest-142130618 None] Created volume successfully. Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Flow 'volume_create_manager' (f4afc41c-aced-4832-8074-2e1c96e2047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b4ff4a-027e-435d-a07b-b7ebcca3376b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b4ff4a-027e-435d-a07b-b7ebcca3376b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1590185293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647d52b5-312d-4d44-b894-507820aeb9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422d7888215446b0b41311599839f221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:14Z,use_quota=True,user_id='140f818792a144919eb85c3f5dbbefde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f56eb0-c79f-450d-aa47-1d277d34f9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f56eb0-c79f-450d-aa47-1d277d34f9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b41174-4ef2-4726-851d-ccda1ae99db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b41174-4ef2-4726-851d-ccda1ae99db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '647d52b5-312d-4d44-b894-507820aeb9c7', 'volume_name': 'volume-647d52b5-312d-4d44-b894-507820aeb9c7', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ab664f-20d0-4c37-a826-e83e1889d7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ab664f-20d0-4c37-a826-e83e1889d7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26f4bc2-8cd1-4779-b751-af1725dfc5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:13 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Volume 647d52b5-312d-4d44-b894-507820aeb9c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-647d52b5-312d-4d44-b894-507820aeb9c7', 'volume_size': 1} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1590185293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647d52b5-312d-4d44-b894-507820aeb9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422d7888215446b0b41311599839f221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:14Z,use_quota=True,user_id='140f818792a144919eb85c3f5dbbefde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Creating volume 647d52b5-312d-4d44-b894-507820aeb9c7 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:13 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:04:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:13 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 1073741824 Nov 04 19:04:13 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:14 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 1073741824" returned: 0 in 0.537s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:14 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 Nov 04 19:04:14 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:14 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7" returned: 0 in 0.383s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26f4bc2-8cd1-4779-b751-af1725dfc5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-647d52b5-312d-4d44-b894-507820aeb9c7', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1b70cd-8d89-4041-a72b-a90bac7d63ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:14 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Volume volume-647d52b5-312d-4d44-b894-507820aeb9c7 (647d52b5-312d-4d44-b894-507820aeb9c7): created successfully Nov 04 19:04:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1b70cd-8d89-4041-a72b-a90bac7d63ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Flow 'volume_create_manager' (f4afc41c-aced-4832-8074-2e1c96e2047d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:14 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0dda5e61-a290-4bc7-a6c0-b34e2aef6730 tempest-VolumesDeleteCascade-1206001411 None] Created volume successfully. Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (a74f6bca-4e0a-46b2-897d-4c72c83fdc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87407acf-6f44-48bf-bdab-73a1dc42a2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87407acf-6f44-48bf-bdab-73a1dc42a2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-239934323',display_name='tempest-VolumesGetTest-Volume-1016566543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433e55e9-e2fe-4251-9902-db6d81305587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:16Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c927f367-1a25-45c2-a842-79e7b5e52088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c927f367-1a25-45c2-a842-79e7b5e52088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bae1e5-3ed1-4bc6-b5d0-0a345c3f1910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bae1e5-3ed1-4bc6-b5d0-0a345c3f1910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '433e55e9-e2fe-4251-9902-db6d81305587', 'volume_name': 'volume-433e55e9-e2fe-4251-9902-db6d81305587', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d2403b-ff18-4928-a798-50a9bf91a5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d2403b-ff18-4928-a798-50a9bf91a5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a865e668-a398-4514-b3c5-831fc6355e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:15 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Volume 433e55e9-e2fe-4251-9902-db6d81305587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-433e55e9-e2fe-4251-9902-db6d81305587', 'volume_size': 1} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-239934323',display_name='tempest-VolumesGetTest-Volume-1016566543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433e55e9-e2fe-4251-9902-db6d81305587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9498cfbf10c1493eb8ab22316f84b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:16Z,use_quota=True,user_id='4d1072c6bec14f7494960f00a2cb1b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Creating volume 433e55e9-e2fe-4251-9902-db6d81305587 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:15 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:04:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:15 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587 1073741824 Nov 04 19:04:15 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:16 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:16 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:16 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587 1073741824" returned: 0 in 0.645s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:16 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.329s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:16 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587 Nov 04 19:04:16 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:04:16 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587" returned: 0 in 0.317s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.536s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] Creating offline snapshot b635903c-1e37-4536-bf6b-8299390197c6 of volume 647d52b5-312d-4d44-b894-507820aeb9c7 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a865e668-a398-4514-b3c5-831fc6355e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433e55e9-e2fe-4251-9902-db6d81305587', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124cdba6-dc7f-4537-928b-26fd6b8fc4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b37773-cdc0-47e2-bb75-931314f49e2c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:16 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Volume volume-433e55e9-e2fe-4251-9902-db6d81305587 (433e55e9-e2fe-4251-9902-db6d81305587): created successfully Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124cdba6-dc7f-4537-928b-26fd6b8fc4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Flow 'volume_create_manager' (a74f6bca-4e0a-46b2-897d-4c72c83fdc2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:16 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1a1fa35f-3863-4882-bf2f-d620d2a085db tempest-VolumesGetTest-142130618 None] Created volume successfully. Nov 04 19:04:16 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 Nov 04 19:04:16 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:17 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7" returned: 0 in 0.408s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:17 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 1G Nov 04 19:04:17 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Flow 'volume_create_manager' (3cd0efc7-949c-4d9b-855c-d8a7eb0915e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32604f30-6a24-4fab-896f-02240b0f7569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32604f30-6a24-4fab-896f-02240b0f7569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-713915061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95deddc9-1969-4436-be8e-0d2cb5aa2936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5948b70704de439b9c8a6dc68f0bc8b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:18Z,use_quota=True,user_id='0c7b6f6939214ff0b182062a4667ce91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b034e4d-fa62-45f6-ad98-c7b144b0df20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b034e4d-fa62-45f6-ad98-c7b144b0df20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b3fec9-59d3-45b7-87b8-70b3d6533130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b3fec9-59d3-45b7-87b8-70b3d6533130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95deddc9-1969-4436-be8e-0d2cb5aa2936', 'volume_name': 'volume-95deddc9-1969-4436-be8e-0d2cb5aa2936', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3545dc-45f4-4c63-baa3-f39c48e6be29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3545dc-45f4-4c63-baa3-f39c48e6be29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab4404b-db50-431e-ac72-fa521ec21a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:17 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Volume 95deddc9-1969-4436-be8e-0d2cb5aa2936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95deddc9-1969-4436-be8e-0d2cb5aa2936', 'volume_size': 1} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:17 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 1G" returned: 0 in 0.565s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-647d52b5-312d-4d44-b894-507820aeb9c7 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:17 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-647d52b5-312d-4d44-b894-507820aeb9c7 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 Nov 04 19:04:17 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-433e55e9-e2fe-4251-9902-db6d81305587-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Lock "cinder-433e55e9-e2fe-4251-9902-db6d81305587-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-quobyte-433e55e9-e2fe-4251-9902-db6d81305587" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-433e55e9-e2fe-4251-9902-db6d81305587" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceee316-6e69-4ccd-ad46-9fe4b08ada61]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:18 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587 Nov 04 19:04:18 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:18 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-647d52b5-312d-4d44-b894-507820aeb9c7 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6" returned: 0 in 0.361s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:18 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 is being set with open permissions: ugo+rw Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:18 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 Nov 04 19:04:18 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:18 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587" returned: 0 in 0.460s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:18 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6" returned: 0 in 0.325s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:18 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587 Nov 04 19:04:18 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:18 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.info Nov 04 19:04:18 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:18 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-433e55e9-e2fe-4251-9902-db6d81305587" returned: 0 in 0.298s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-433e55e9-e2fe-4251-9902-db6d81305587" released by "delete_volume" :: held 0.813s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:18 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.info" returned: 0 in 0.289s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:18 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.info is being set with open permissions: ugo+rw Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:18 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.info Nov 04 19:04:18 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Created reservations ['8460c303-0178-4253-b759-c09bf3ac9bd0', '17e0421e-0fe3-4b1c-8a0b-dac20f02eddb', 'fd87afec-1e3d-417f-8dc8-cda774dc8c2a', '51175177-77f0-448a-9a3f-c4ff72b5f30b'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:19 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:19 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:19 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.info" returned: 0 in 0.316s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.479s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-713915061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95deddc9-1969-4436-be8e-0d2cb5aa2936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5948b70704de439b9c8a6dc68f0bc8b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:18Z,use_quota=True,user_id='0c7b6f6939214ff0b182062a4667ce91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Creating volume 95deddc9-1969-4436-be8e-0d2cb5aa2936 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:19 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-10860568-b994-447a-8ed2-bbd5218d2b92-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:19 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 1073741824 Nov 04 19:04:19 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Lock "cinder-10860568-b994-447a-8ed2-bbd5218d2b92-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:19 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c33b4fa3-0c48-4f0a-9e63-d8a2682e513b tempest-VolumesDeleteCascade-1206001411 None] Create snapshot completed successfully Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Acquiring lock "cinder-quobyte-10860568-b994-447a-8ed2-bbd5218d2b92" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:19 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-10860568-b994-447a-8ed2-bbd5218d2b92" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.446s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:19 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Deleted volume successfully. Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc095ab-7f3a-4774-89a4-fb9296337ced]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-62b3c1b0-96e0-4e83-9e9f-0e9ee3815af5 tempest-VolumesGetTest-142130618 None] Lock "cinder-433e55e9-e2fe-4251-9902-db6d81305587-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:19 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 Nov 04 19:04:19 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:19 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 1073741824" returned: 0 in 0.685s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:19 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92" returned: 0 in 0.538s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:20 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 Nov 04 19:04:20 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:20 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92 Nov 04 19:04:20 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:20 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936" returned: 0 in 0.346s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab4404b-db50-431e-ac72-fa521ec21a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95deddc9-1969-4436-be8e-0d2cb5aa2936', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552e7968-9e41-475a-8a1b-be12420526f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:20 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Volume volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 (95deddc9-1969-4436-be8e-0d2cb5aa2936): created successfully Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552e7968-9e41-475a-8a1b-be12420526f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Flow 'volume_create_manager' (3cd0efc7-949c-4d9b-855c-d8a7eb0915e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:20 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-10860568-b994-447a-8ed2-bbd5218d2b92" returned: 0 in 0.447s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:20 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e4bd23ee-042c-4dc9-84c7-b7f6ecfec31a tempest-TestStampPattern-1157282596 None] Created volume successfully. Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Lock "cinder-quobyte-10860568-b994-447a-8ed2-bbd5218d2b92" released by "delete_volume" :: held 1.067s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Created reservations ['2fd62c24-19f3-4d44-8a4a-b83e3278aacb', '8982ab98-0fcb-42f1-b5d7-80b13a69b3b2', '593a9d4d-14b6-40bc-917a-23e62263a942', '3137e542-361b-4f9f-b4df-4eae413f52d3'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:20 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:20 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] Creating offline snapshot 9f3a7af2-79a2-429c-93e0-94db7e3036e9 of volume 647d52b5-312d-4d44-b894-507820aeb9c7 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d24f1fa-358b-42c1-8617-0ecda906f082]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:21 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.360s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:21 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:21 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Deleted volume successfully. Nov 04 19:04:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d82e4674-b95a-4bbf-87e3-a68e389576f1 tempest-VolumesGetTest-142130618 None] Lock "cinder-10860568-b994-447a-8ed2-bbd5218d2b92-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:21 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 Nov 04 19:04:21 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:21 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6" returned: 0 in 0.471s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-647d52b5-312d-4d44-b894-507820aeb9c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:21 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 1G Nov 04 19:04:21 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:21 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 1G" returned: 0 in 0.556s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:22 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 Nov 04 19:04:22 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:22 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9" returned: 0 in 0.416s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:22 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 is being set with open permissions: ugo+rw Nov 04 19:04:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:22 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 Nov 04 19:04:22 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:22 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:22 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9d678a0d-97ec-475b-a208-5cc3f6c4a3b2 tempest-VolumesDeleteCascade-1206001411 None] Create snapshot completed successfully Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-647d52b5-312d-4d44-b894-507820aeb9c7-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-647d52b5-312d-4d44-b894-507820aeb9c7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Performing cascade delete. {{(pid=87364) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-9f3a7af2-79a2-429c-93e0-94db7e3036e9-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-9f3a7af2-79a2-429c-93e0-94db7e3036e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-quobyte-647d52b5-312d-4d44-b894-507820aeb9c7" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-647d52b5-312d-4d44-b894-507820aeb9c7" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-quobyte-9f3a7af2-79a2-429c-93e0-94db7e3036e9" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-9f3a7af2-79a2-429c-93e0-94db7e3036e9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Deleting offline snapshot 9f3a7af2-79a2-429c-93e0-94db7e3036e9 of volume 647d52b5-312d-4d44-b894-507820aeb9c7 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] snapshot_file for this snap is: volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e29e031-d7be-40d5-98f0-18d8713fea70]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:23 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 Nov 04 19:04:23 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:24 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9" returned: 0 in 0.916s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-647d52b5-312d-4d44-b894-507820aeb9c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:24 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42ca920-775a-40bf-9d44-89821c07e230]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:24 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 Nov 04 19:04:24 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:24 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6" returned: 0 in 0.590s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-647d52b5-312d-4d44-b894-507820aeb9c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:25 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 Nov 04 19:04:25 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:25 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9" returned: 0 in 0.681s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:25 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9 Nov 04 19:04:25 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:25 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.9f3a7af2-79a2-429c-93e0-94db7e3036e9" returned: 0 in 0.307s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-9f3a7af2-79a2-429c-93e0-94db7e3036e9" released by "_delete_snapshot" :: held 2.732s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-647d52b5-312d-4d44-b894-507820aeb9c7" released by "delete_snapshot" :: held 2.766s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Created reservations ['020efdef-9894-4489-be83-c7a629a9870a', 'cc431ae9-30ae-47d3-88e2-798fa0fe28b0', '25e9c322-3534-42f5-8af7-ef85e3a9d45b', '3246fc6b-3232-4b0d-bce1-be49997a3d75'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:26 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Delete snapshot completed successfully. Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-9f3a7af2-79a2-429c-93e0-94db7e3036e9-delete_snapshot" released by "delete_snapshot" :: held 3.017s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-b635903c-1e37-4536-bf6b-8299390197c6-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-b635903c-1e37-4536-bf6b-8299390197c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-quobyte-647d52b5-312d-4d44-b894-507820aeb9c7" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-647d52b5-312d-4d44-b894-507820aeb9c7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-quobyte-b635903c-1e37-4536-bf6b-8299390197c6" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-b635903c-1e37-4536-bf6b-8299390197c6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Deleting offline snapshot b635903c-1e37-4536-bf6b-8299390197c6 of volume 647d52b5-312d-4d44-b894-507820aeb9c7 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] snapshot_file for this snap is: volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d47f60-ef43-4fb7-80df-110e7685e32e]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:26 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 Nov 04 19:04:26 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:26 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6" returned: 0 in 0.539s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-647d52b5-312d-4d44-b894-507820aeb9c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc14077f-165e-4f9a-9470-839368151a64]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:27 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 Nov 04 19:04:27 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:27 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7" returned: 0 in 0.522s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:27 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 Nov 04 19:04:27 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:28 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6" returned: 0 in 0.547s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:28 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6 Nov 04 19:04:28 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Flow 'volume_create_manager' (4b3eb526-f0d7-4eba-a9ca-d432db512ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2bea0d-8cfa-4485-b24c-cc5ea657c784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2bea0d-8cfa-4485-b24c-cc5ea657c784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1784021805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f15db5-53ac-443a-8305-95e8b6159222,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed424bfaf0c1493fbd1f22fcdd9e3eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:28Z,use_quota=True,user_id='552fbda8f0cf4444abe8032aa6145176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5050ddf-685b-46c2-874a-f2df11d732d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5050ddf-685b-46c2-874a-f2df11d732d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0471bd47-9579-4897-8d78-05f3983fb81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0471bd47-9579-4897-8d78-05f3983fb81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f15db5-53ac-443a-8305-95e8b6159222', 'volume_name': 'volume-46f15db5-53ac-443a-8305-95e8b6159222', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cd4523-1c20-499c-962a-dcea790c2d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cd4523-1c20-499c-962a-dcea790c2d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ce96c4-ae8f-4a2f-ab6c-2120c936f3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:28 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:28 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Volume 46f15db5-53ac-443a-8305-95e8b6159222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f15db5-53ac-443a-8305-95e8b6159222', 'volume_size': 1} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1784021805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f15db5-53ac-443a-8305-95e8b6159222,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed424bfaf0c1493fbd1f22fcdd9e3eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:28Z,use_quota=True,user_id='552fbda8f0cf4444abe8032aa6145176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Creating volume 46f15db5-53ac-443a-8305-95e8b6159222 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:28 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7.b635903c-1e37-4536-bf6b-8299390197c6" returned: 0 in 0.437s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:28 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222 1073741824 Nov 04 19:04:28 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-b635903c-1e37-4536-bf6b-8299390197c6" released by "_delete_snapshot" :: held 2.225s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-647d52b5-312d-4d44-b894-507820aeb9c7" released by "delete_snapshot" :: held 2.256s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Created reservations ['a2a5cff5-0339-4333-87ba-3f7137183966', 'ed55eaea-df4d-45d0-ada8-c3019f58dec7', '9ea788e8-61eb-40d0-8820-8c9b28696978', '459807a4-75b1-49f1-a954-1346caff3260'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:28 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Delete snapshot completed successfully. Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-b635903c-1e37-4536-bf6b-8299390197c6-delete_snapshot" released by "delete_snapshot" :: held 2.503s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Snapshots deleted, issuing volume delete {{(pid=87364) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-quobyte-647d52b5-312d-4d44-b894-507820aeb9c7" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-647d52b5-312d-4d44-b894-507820aeb9c7" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b17ccb8-e693-4ccd-8932-1574fdf54a92]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:28 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 Nov 04 19:04:28 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:29 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222 1073741824" returned: 0 in 0.696s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:29 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222 Nov 04 19:04:29 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:29 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7" returned: 0 in 0.558s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:29 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7 Nov 04 19:04:29 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:29 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222" returned: 0 in 0.315s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ce96c4-ae8f-4a2f-ab6c-2120c936f3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f15db5-53ac-443a-8305-95e8b6159222', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d462c8-d8b4-44e1-9533-584bd886367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:29 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Volume volume-46f15db5-53ac-443a-8305-95e8b6159222 (46f15db5-53ac-443a-8305-95e8b6159222): created successfully Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d462c8-d8b4-44e1-9533-584bd886367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Flow 'volume_create_manager' (4b3eb526-f0d7-4eba-a9ca-d432db512ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:29 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-30247132-a218-4565-8ff7-39261623b38c tempest-VolumesListTestJSON-1304891209 None] Created volume successfully. Nov 04 19:04:29 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-647d52b5-312d-4d44-b894-507820aeb9c7" returned: 0 in 0.329s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-647d52b5-312d-4d44-b894-507820aeb9c7" released by "delete_volume" :: held 0.978s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Created reservations ['a6a766b0-a613-4794-b478-4e7263dc64fd', '5768e101-21f9-49de-b980-6bc929594b8b', '6803ef83-e76a-45fb-a25f-fc2854af03a6', 'd84bbfb9-1dbe-494e-8937-ae2c181c227a'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:29 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:29 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:30 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.298s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:30 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:30 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Deleted volume successfully. Nov 04 19:04:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2a09a313-8d93-4a60-90ca-d160393a6f65 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-647d52b5-312d-4d44-b894-507820aeb9c7-delete_volume" released by "delete_volume" :: held 7.218s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Flow 'volume_create_manager' (4101d81d-bb77-48ed-8171-20c82953d933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55fcf05b-136c-4b6a-ac2d-86170e078b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55fcf05b-136c-4b6a-ac2d-86170e078b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1740921682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4701ac0-6838-4fda-b7b0-ee093098b198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422d7888215446b0b41311599839f221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:31Z,use_quota=True,user_id='140f818792a144919eb85c3f5dbbefde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b194ae5-c069-43ac-b45a-56b80d911689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b194ae5-c069-43ac-b45a-56b80d911689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4754a7-8772-4481-b823-184174c0aa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4754a7-8772-4481-b823-184174c0aa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4701ac0-6838-4fda-b7b0-ee093098b198', 'volume_name': 'volume-d4701ac0-6838-4fda-b7b0-ee093098b198', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c460edb-c0fd-47df-9ae6-41403941e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c460edb-c0fd-47df-9ae6-41403941e51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec7f60c-4316-408e-8fa2-6e89ec07e206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:31 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Volume d4701ac0-6838-4fda-b7b0-ee093098b198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4701ac0-6838-4fda-b7b0-ee093098b198', 'volume_size': 1} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1740921682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4701ac0-6838-4fda-b7b0-ee093098b198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422d7888215446b0b41311599839f221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:31Z,use_quota=True,user_id='140f818792a144919eb85c3f5dbbefde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Creating volume d4701ac0-6838-4fda-b7b0-ee093098b198 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:31 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:31 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 1073741824 Nov 04 19:04:31 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Flow 'volume_create_manager' (ac804f11-04f6-4cd6-b458-c9627ed21da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac8f224-5ef5-4a38-b070-5c79479caf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac8f224-5ef5-4a38-b070-5c79479caf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-28539313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8576f3af-e32a-46ce-a811-7c527e2f6399,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed424bfaf0c1493fbd1f22fcdd9e3eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:31Z,use_quota=True,user_id='552fbda8f0cf4444abe8032aa6145176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dcc625-d52e-4815-ac7a-54e6fcbd39e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dcc625-d52e-4815-ac7a-54e6fcbd39e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0d05da-78ab-4be4-9f03-a267b7113c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0d05da-78ab-4be4-9f03-a267b7113c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8576f3af-e32a-46ce-a811-7c527e2f6399', 'volume_name': 'volume-8576f3af-e32a-46ce-a811-7c527e2f6399', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb6a40b-1e25-43fb-9f96-fac5a5a5bedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb6a40b-1e25-43fb-9f96-fac5a5a5bedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1a5cb6-3d7d-4953-8396-8f54d2dabbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:31 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Volume 8576f3af-e32a-46ce-a811-7c527e2f6399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8576f3af-e32a-46ce-a811-7c527e2f6399', 'volume_size': 1} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:31 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 1073741824" returned: 0 in 0.452s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:31 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 Nov 04 19:04:31 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:32 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198" returned: 0 in 0.276s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-28539313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8576f3af-e32a-46ce-a811-7c527e2f6399,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed424bfaf0c1493fbd1f22fcdd9e3eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:31Z,use_quota=True,user_id='552fbda8f0cf4444abe8032aa6145176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Creating volume 8576f3af-e32a-46ce-a811-7c527e2f6399 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:32 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec7f60c-4316-408e-8fa2-6e89ec07e206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4701ac0-6838-4fda-b7b0-ee093098b198', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94568a7c-df06-4d14-a01b-1fc749cf4fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:32 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399 1073741824 Nov 04 19:04:32 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:32 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Volume volume-d4701ac0-6838-4fda-b7b0-ee093098b198 (d4701ac0-6838-4fda-b7b0-ee093098b198): created successfully Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94568a7c-df06-4d14-a01b-1fc749cf4fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Flow 'volume_create_manager' (4101d81d-bb77-48ed-8171-20c82953d933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:32 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-31c5a5ed-454d-461a-bdd9-e41d46509182 tempest-VolumesDeleteCascade-1206001411 None] Created volume successfully. Nov 04 19:04:32 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399 1073741824" returned: 0 in 0.448s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:32 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399 Nov 04 19:04:32 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:32 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399" returned: 0 in 0.253s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1a5cb6-3d7d-4953-8396-8f54d2dabbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8576f3af-e32a-46ce-a811-7c527e2f6399', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0714a4-108a-4484-944b-c3ce2b14d15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:32 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Volume volume-8576f3af-e32a-46ce-a811-7c527e2f6399 (8576f3af-e32a-46ce-a811-7c527e2f6399): created successfully Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0714a4-108a-4484-944b-c3ce2b14d15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Flow 'volume_create_manager' (ac804f11-04f6-4cd6-b458-c9627ed21da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-144b7aa4-7fac-44e0-b96a-3e304a6a3f03 tempest-VolumesListTestJSON-1304891209 None] Created volume successfully. Nov 04 19:04:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] Creating offline snapshot 4cb2c55b-e2c8-478c-9776-55b813bb72fa of volume d4701ac0-6838-4fda-b7b0-ee093098b198 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:33 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[332a9c57-dc49-40b2-9a67-7e50b2913680]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:33 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 Nov 04 19:04:33 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:33 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:33 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Flow 'volume_create_manager' (ac7e9381-762d-40cb-a2a0-31cc7e900602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba77e23d-99dd-4b7c-b252-65fe9ba936ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198" returned: 0 in 0.483s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba77e23d-99dd-4b7c-b252-65fe9ba936ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1062242296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea856829-dbd4-4a98-9830-ccf50442d16a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed424bfaf0c1493fbd1f22fcdd9e3eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:34Z,use_quota=True,user_id='552fbda8f0cf4444abe8032aa6145176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:33 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa 1G Nov 04 19:04:33 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe2b6eb-6a31-4a49-9c75-fcec45e2510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe2b6eb-6a31-4a49-9c75-fcec45e2510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33266d73-021d-496b-8af3-e216a17c4614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33266d73-021d-496b-8af3-e216a17c4614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea856829-dbd4-4a98-9830-ccf50442d16a', 'volume_name': 'volume-ea856829-dbd4-4a98-9830-ccf50442d16a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295f5028-c411-45cf-9dd2-16cb9e45d1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295f5028-c411-45cf-9dd2-16cb9e45d1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b4e83c-1fb8-419b-8f53-4256e1602711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:34 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Volume ea856829-dbd4-4a98-9830-ccf50442d16a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea856829-dbd4-4a98-9830-ccf50442d16a', 'volume_size': 1} Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:34 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa 1G" returned: 0 in 0.425s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4701ac0-6838-4fda-b7b0-ee093098b198 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:34 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4701ac0-6838-4fda-b7b0-ee093098b198 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa Nov 04 19:04:34 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:34 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4701ac0-6838-4fda-b7b0-ee093098b198 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa" returned: 0 in 0.296s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:34 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa is being set with open permissions: ugo+rw Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:34 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa Nov 04 19:04:34 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:34 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa" returned: 0 in 0.265s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:35 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.info Nov 04 19:04:35 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:35 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.info" returned: 0 in 0.258s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:35 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.info is being set with open permissions: ugo+rw Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:35 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.info Nov 04 19:04:35 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:35 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.info" returned: 0 in 0.270s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1062242296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea856829-dbd4-4a98-9830-ccf50442d16a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ed424bfaf0c1493fbd1f22fcdd9e3eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:34Z,use_quota=True,user_id='552fbda8f0cf4444abe8032aa6145176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Creating volume ea856829-dbd4-4a98-9830-ccf50442d16a {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:35 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:04:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:35 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a 1073741824 Nov 04 19:04:35 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:35 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-20cfa44b-809f-49f0-8169-abf43ef0031a tempest-VolumesDeleteCascade-1206001411 None] Create snapshot completed successfully Nov 04 19:04:36 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a 1073741824" returned: 0 in 0.488s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:36 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a Nov 04 19:04:36 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:36 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a" returned: 0 in 0.268s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b4e83c-1fb8-419b-8f53-4256e1602711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea856829-dbd4-4a98-9830-ccf50442d16a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca32b08-8c6f-448d-8398-a8eb9d276548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:36 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Volume volume-ea856829-dbd4-4a98-9830-ccf50442d16a (ea856829-dbd4-4a98-9830-ccf50442d16a): created successfully Nov 04 19:04:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca32b08-8c6f-448d-8398-a8eb9d276548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Flow 'volume_create_manager' (ac7e9381-762d-40cb-a2a0-31cc7e900602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b485a243-c598-4c6b-beb3-b56a2fa944df tempest-VolumesListTestJSON-1304891209 None] Created volume successfully. Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Flow 'volume_create_manager' (a29ac2be-8fb8-4f0b-b781-3f2c43882487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d924b296-027a-4347-824a-7f37e58ce8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d924b296-027a-4347-824a-7f37e58ce8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2039585535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffffec56-01dc-4ab0-b755-26f7d95b3e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422d7888215446b0b41311599839f221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4cb2c55b-e2c8-478c-9776-55b813bb72fa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:37Z,use_quota=True,user_id='140f818792a144919eb85c3f5dbbefde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43dfd1a-6317-4910-81e0-dbc74dfd6152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43dfd1a-6317-4910-81e0-dbc74dfd6152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f610cab6-dbf9-46c2-9603-d1a7d7ba3820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f610cab6-dbf9-46c2-9603-d1a7d7ba3820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ffffec56-01dc-4ab0-b755-26f7d95b3e21', 'volume_name': 'volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21', 'volume_size': 1, 'snapshot_id': '4cb2c55b-e2c8-478c-9776-55b813bb72fa'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1922ae58-8c0e-4cef-b7e1-32c02177361d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1922ae58-8c0e-4cef-b7e1-32c02177361d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a24118-7775-4a41-ad71-f7b3320ec69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:37 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Volume ffffec56-01dc-4ab0-b755-26f7d95b3e21: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21', 'volume_size': 1, 'snapshot_id': '4cb2c55b-e2c8-478c-9776-55b813bb72fa'} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-quobyte-4cb2c55b-e2c8-478c-9776-55b813bb72fa-ffffec56-01dc-4ab0-b755-26f7d95b3e21" by "_create_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-4cb2c55b-e2c8-478c-9776-55b813bb72fa-ffffec56-01dc-4ab0-b755-26f7d95b3e21" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Creating volume ffffec56-01dc-4ab0-b755-26f7d95b3e21 from snapshot 4cb2c55b-e2c8-478c-9776-55b813bb72fa {{(pid=87364) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-quobyte-ffffec56-01dc-4ab0-b755-26f7d95b3e21" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-ffffec56-01dc-4ab0-b755-26f7d95b3e21" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] snapshot: 4cb2c55b-e2c8-478c-9776-55b813bb72fa, volume: ffffec56-01dc-4ab0-b755-26f7d95b3e21, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a7b21a-70b0-4dfc-b1c3-093def2add37]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:37 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa Nov 04 19:04:37 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:37 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa" returned: 0 in 0.466s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4701ac0-6838-4fda-b7b0-ee093098b198(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd4e621-80a5-48cd-a525-19fb3ebb2c5b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:38 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 Nov 04 19:04:38 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:38 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198" returned: 0 in 0.412s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:04:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:04:38 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:04:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:38 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 Nov 04 19:04:38 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:39 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "cinder-ea856829-dbd4-4a98-9830-ccf50442d16a-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:39 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-ea856829-dbd4-4a98-9830-ccf50442d16a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:39 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "cinder-quobyte-ea856829-dbd4-4a98-9830-ccf50442d16a" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:39 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-quobyte-ea856829-dbd4-4a98-9830-ccf50442d16a" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:39 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[819affe9-ae94-44cf-bff3-684ebd0a11e2]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:40 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a Nov 04 19:04:40 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:40 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a" returned: 0 in 0.593s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:40 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a Nov 04 19:04:40 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:40 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ea856829-dbd4-4a98-9830-ccf50442d16a" returned: 0 in 0.337s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-quobyte-ea856829-dbd4-4a98-9830-ccf50442d16a" released by "delete_volume" :: held 1.018s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:41 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Created reservations ['b5dd183c-3422-42bc-bf3f-b5c173107a49', '96e653ff-4baf-4132-8f34-2248655f6434', '4b419afe-d1d3-46c6-a65e-a467e687cc6c', 'e39da0ad-8f38-41f8-a3e1-3257272abeb0'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:41 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:41 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:41 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.378s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:41 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Deleted volume successfully. Nov 04 19:04:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d568cef5-8ff3-4f0a-8a01-4a633888fd48 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-ea856829-dbd4-4a98-9830-ccf50442d16a-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "cinder-8576f3af-e32a-46ce-a811-7c527e2f6399-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-8576f3af-e32a-46ce-a811-7c527e2f6399-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "cinder-quobyte-8576f3af-e32a-46ce-a811-7c527e2f6399" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-quobyte-8576f3af-e32a-46ce-a811-7c527e2f6399" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:42 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a502ba58-696f-4f58-a65d-54f8b88b6b0b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:42 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399 Nov 04 19:04:42 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:43 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399" returned: 0 in 0.759s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:43 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399 Nov 04 19:04:43 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:43 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8576f3af-e32a-46ce-a811-7c527e2f6399" returned: 0 in 0.474s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-quobyte-8576f3af-e32a-46ce-a811-7c527e2f6399" released by "delete_volume" :: held 1.335s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:43 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Created reservations ['f97417b4-c5f8-4a88-9335-212597f2cea6', 'dc0e6f79-e5ec-429b-b38a-dab3dd48416b', '535e9a3b-e2ad-47ba-a704-9fccedd8030c', '7c6ead57-495e-44eb-b820-0cf8bd26e6da'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:44 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:44 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:44 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.621s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:44 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:44 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Deleted volume successfully. Nov 04 19:04:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3cb22a85-57b7-459b-bcaf-b69eeee4d067 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-8576f3af-e32a-46ce-a811-7c527e2f6399-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "cinder-46f15db5-53ac-443a-8305-95e8b6159222-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-46f15db5-53ac-443a-8305-95e8b6159222-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "cinder-quobyte-46f15db5-53ac-443a-8305-95e8b6159222" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-quobyte-46f15db5-53ac-443a-8305-95e8b6159222" acquired by "delete_volume" :: waited 0.040s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37eef5e-6883-4022-9b26-7a2c82191278]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:45 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222 Nov 04 19:04:45 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:45 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21" returned: 0 in 7.151s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:04:45 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Converted 1024.00 MB image at 143.17 MB/s Nov 04 19:04:45 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 is being set with open permissions: ugo+rw Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:45 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 Nov 04 19:04:45 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:45 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222" returned: 0 in 0.537s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:45 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222 Nov 04 19:04:45 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:45 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21" returned: 0 in 0.306s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-ffffec56-01dc-4ab0-b755-26f7d95b3e21" released by "_copy_volume_from_snapshot" :: held 8.434s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-4cb2c55b-e2c8-478c-9776-55b813bb72fa-ffffec56-01dc-4ab0-b755-26f7d95b3e21" released by "_create_volume_from_snapshot" :: held 8.528s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.550s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a24118-7775-4a41-ad71-f7b3320ec69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21', 'volume_size': 1, 'snapshot_id': '4cb2c55b-e2c8-478c-9776-55b813bb72fa'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc99ea06-0032-41f3-88f1-36f5e71f18ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:45 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Volume volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 (ffffec56-01dc-4ab0-b755-26f7d95b3e21): created successfully Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc99ea06-0032-41f3-88f1-36f5e71f18ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Flow 'volume_create_manager' (a29ac2be-8fb8-4f0b-b781-3f2c43882487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2577c1f7-6ade-4417-bc02-b00e13fc3287 tempest-VolumesDeleteCascade-1206001411 None] Created volume successfully. Nov 04 19:04:45 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-46f15db5-53ac-443a-8305-95e8b6159222" returned: 0 in 0.295s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-quobyte-46f15db5-53ac-443a-8305-95e8b6159222" released by "delete_volume" :: held 0.905s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:46 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Created reservations ['f2253835-3675-4eb1-a61c-432b03666860', '1408741c-aca8-493b-b3bd-b8f4e94dc5d4', 'c9a5dac3-6763-4d87-865c-d4075168bdfc', 'd71ba41a-f661-4378-b97a-2ec8cab24dd2'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:46 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:46 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:46 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.277s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:46 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:46 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Deleted volume successfully. Nov 04 19:04:46 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b00616f7-4428-419b-843c-c2914b599b90 tempest-VolumesListTestJSON-1304891209 None] Lock "cinder-46f15db5-53ac-443a-8305-95e8b6159222-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-d4701ac0-6838-4fda-b7b0-ee093098b198-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-d4701ac0-6838-4fda-b7b0-ee093098b198-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Performing cascade delete. {{(pid=87364) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-4cb2c55b-e2c8-478c-9776-55b813bb72fa-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-4cb2c55b-e2c8-478c-9776-55b813bb72fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-quobyte-d4701ac0-6838-4fda-b7b0-ee093098b198" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-d4701ac0-6838-4fda-b7b0-ee093098b198" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-quobyte-4cb2c55b-e2c8-478c-9776-55b813bb72fa" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-4cb2c55b-e2c8-478c-9776-55b813bb72fa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Deleting offline snapshot 4cb2c55b-e2c8-478c-9776-55b813bb72fa of volume d4701ac0-6838-4fda-b7b0-ee093098b198 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] snapshot_file for this snap is: volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df582e-802d-406c-9836-2993c03de747]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:47 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa Nov 04 19:04:47 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:47 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa" returned: 0 in 0.471s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4701ac0-6838-4fda-b7b0-ee093098b198(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa28b40a-c1a5-4b98-aa13-9145a13af2d9]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:48 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 Nov 04 19:04:48 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:48 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198" returned: 0 in 0.643s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:48 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa Nov 04 19:04:48 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:48 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa" returned: 0 in 0.381s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:48 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa Nov 04 19:04:48 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:49 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198.4cb2c55b-e2c8-478c-9776-55b813bb72fa" returned: 0 in 0.256s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-4cb2c55b-e2c8-478c-9776-55b813bb72fa" released by "_delete_snapshot" :: held 1.883s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-d4701ac0-6838-4fda-b7b0-ee093098b198" released by "delete_snapshot" :: held 1.917s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Created reservations ['2e00be76-7e87-4a9a-8f30-8269610c0ad4', '17b62f22-3e2b-4417-82ba-949521e7f35e', '504f6baa-3f6f-4805-a90d-26a378051c28', '9275ebf9-cef0-4435-8328-526ecfd09f48'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:49 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Delete snapshot completed successfully. Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-4cb2c55b-e2c8-478c-9776-55b813bb72fa-delete_snapshot" released by "delete_snapshot" :: held 2.101s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Snapshots deleted, issuing volume delete {{(pid=87364) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-quobyte-d4701ac0-6838-4fda-b7b0-ee093098b198" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-d4701ac0-6838-4fda-b7b0-ee093098b198" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3f3e50-4d30-4868-85e4-683a364dee08]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:49 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 Nov 04 19:04:49 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:49 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198" returned: 0 in 0.450s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:49 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198 Nov 04 19:04:49 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:50 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d4701ac0-6838-4fda-b7b0-ee093098b198" returned: 0 in 0.316s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-d4701ac0-6838-4fda-b7b0-ee093098b198" released by "delete_volume" :: held 0.845s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Created reservations ['6d23bb1d-0713-438b-bc62-dc3d9484add2', '050ead06-0c19-4fac-94b3-9f771d6b87c5', '86213c5f-de79-4a95-82e8-a4d99415840b', '0c39303e-c753-4046-abc8-f996614aaef3'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:50 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:50 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Flow 'volume_create_manager' (bc7574e9-1546-48b7-b5fc-134401cd2154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ae238d-ca07-4bff-a597-29f65119e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ae238d-ca07-4bff-a597-29f65119e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-615393655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be429f85-36b1-4c5d-882c-ed87bb5c7761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d36b19265c431d83eee0741391a220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:51Z,use_quota=True,user_id='5102794ee150458fbeae652efd1ca967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb1ff81-49a9-423b-b0b6-cea3a4b7ec5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb1ff81-49a9-423b-b0b6-cea3a4b7ec5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd1d5d7-6d43-4919-8b2b-9ce7412f7319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd1d5d7-6d43-4919-8b2b-9ce7412f7319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be429f85-36b1-4c5d-882c-ed87bb5c7761', 'volume_name': 'volume-be429f85-36b1-4c5d-882c-ed87bb5c7761', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6c2077-bab3-47e2-a7d1-a17c9a39a7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6c2077-bab3-47e2-a7d1-a17c9a39a7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2957f191-93c4-4f69-8254-dceb62c1a6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:50 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Volume be429f85-36b1-4c5d-882c-ed87bb5c7761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be429f85-36b1-4c5d-882c-ed87bb5c7761', 'volume_size': 1} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-615393655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be429f85-36b1-4c5d-882c-ed87bb5c7761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d36b19265c431d83eee0741391a220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:51Z,use_quota=True,user_id='5102794ee150458fbeae652efd1ca967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Creating volume be429f85-36b1-4c5d-882c-ed87bb5c7761 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:04:50 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-ffffec56-01dc-4ab0-b755-26f7d95b3e21-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-ffffec56-01dc-4ab0-b755-26f7d95b3e21-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:50 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:50 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761 1073741824 Nov 04 19:04:50 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.444s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:50 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Deleted volume successfully. Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "cinder-quobyte-ffffec56-01dc-4ab0-b755-26f7d95b3e21" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-13db2cb2-055a-4c41-85d4-27e5629cdf4d tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-d4701ac0-6838-4fda-b7b0-ee093098b198-delete_volume" released by "delete_volume" :: held 3.730s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-e5f4851b-d7b2-4ea5-9083-2ea0de6fbe0e req-25ddf96e-1823-4b44-95ed-2d4130622330 tempest-TestStampPattern-1157282596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-ffffec56-01dc-4ab0-b755-26f7d95b3e21" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf465310-27a3-4bfb-8169-a17064b2aa17]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:51 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 Nov 04 19:04:51 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:51 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761 1073741824" returned: 0 in 0.493s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:51 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761 Nov 04 19:04:51 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:51 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21" returned: 0 in 0.422s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:51 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21 Nov 04 19:04:51 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:51 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761" returned: 0 in 0.278s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-e5f4851b-d7b2-4ea5-9083-2ea0de6fbe0e req-25ddf96e-1823-4b44-95ed-2d4130622330 tempest-TestStampPattern-1157282596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.694s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-e5f4851b-d7b2-4ea5-9083-2ea0de6fbe0e req-25ddf96e-1823-4b44-95ed-2d4130622330 tempest-TestStampPattern-1157282596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2957f191-93c4-4f69-8254-dceb62c1a6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be429f85-36b1-4c5d-882c-ed87bb5c7761', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:51 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a28c918-745d-4fa8-99cc-9ea759c0d036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ffffec56-01dc-4ab0-b755-26f7d95b3e21" returned: 0 in 0.284s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:51 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Volume volume-be429f85-36b1-4c5d-882c-ed87bb5c7761 (be429f85-36b1-4c5d-882c-ed87bb5c7761): created successfully Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a28c918-745d-4fa8-99cc-9ea759c0d036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Flow 'volume_create_manager' (bc7574e9-1546-48b7-b5fc-134401cd2154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-quobyte-ffffec56-01dc-4ab0-b755-26f7d95b3e21" released by "delete_volume" :: held 0.765s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:51 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4fd5a70c-24b0-45eb-9017-482916c15f30 tempest-VolumesNegativeTest-1021668364 None] Created volume successfully. Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-e5f4851b-d7b2-4ea5-9083-2ea0de6fbe0e req-25ddf96e-1823-4b44-95ed-2d4130622330 tempest-TestStampPattern-1157282596 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-95deddc9-1969-4436-be8e-0d2cb5aa2936', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8c816fb-bc16-454e-b54e-e6ffd5f012fa', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Created reservations ['3c49855d-6f4f-43e3-bdfa-d637e7758765', 'b78c18e7-2b57-4731-b483-38759e0310e4', 'db4a3435-9d9b-4dd1-995b-44a66dcba24a', 'f997ee7d-883f-45d8-b8f8-3d0f444d924b'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:04:51 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-e5f4851b-d7b2-4ea5-9083-2ea0de6fbe0e req-25ddf96e-1823-4b44-95ed-2d4130622330 tempest-TestStampPattern-1157282596 None] attachment_update completed successfully. Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:04:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:51 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:04:51 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:52 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.299s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:52 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:04:52 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Deleted volume successfully. Nov 04 19:04:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-252e581b-af9f-4834-b9e7-17ac2784c343 tempest-VolumesDeleteCascade-1206001411 None] Lock "cinder-ffffec56-01dc-4ab0-b755-26f7d95b3e21-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:04:57 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=168,cinder:SELECT=136,cinder:INSERT=44,cinder:DELETE=15 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:04:57 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=164,cinder:SELECT=136,cinder:INSERT=49,cinder:DELETE=14 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:04:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-88aa78c9-ae48-4356-9f30-b683f00d4213 req-729f6ef4-a788-41a9-8313-960bca6af847 tempest-TestStampPattern-1157282596 None] Terminate volume connection completed successfully. Nov 04 19:04:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-88aa78c9-ae48-4356-9f30-b683f00d4213 req-729f6ef4-a788-41a9-8313-960bca6af847 tempest-TestStampPattern-1157282596 None] Deleting attachment c8c816fb-bc16-454e-b54e-e6ffd5f012fa. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:04:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:04:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] Creating offline snapshot 6533ba9e-e70e-47ce-9aac-7998ac51ceed of volume 95deddc9-1969-4436-be8e-0d2cb5aa2936 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:04:58 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaa0755-f2af-48b6-be8e-8d80e4d6e104]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:04:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:58 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 Nov 04 19:04:58 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936" returned: 0 in 0.572s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:59 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:04:59 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed 1G Nov 04 19:04:59 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Flow 'volume_create_manager' (0fb6e999-1e24-420b-b920-0a47b5ef33d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c3f47e-d3ce-40aa-af39-66e0943f1fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c3f47e-d3ce-40aa-af39-66e0943f1fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-458013181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7aeba4-efba-4b2a-9418-47b0fe48f133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f994e1a5ff43d1bb3805866c0a5d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:59Z,use_quota=True,user_id='caea5ed8f3114862afa2c2c1442fbf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf884881-4773-4174-9a7d-20e3a08298d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf884881-4773-4174-9a7d-20e3a08298d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26a4f66-e241-412f-be58-2fc94cf7bba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26a4f66-e241-412f-be58-2fc94cf7bba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b7aeba4-efba-4b2a-9418-47b0fe48f133', 'volume_name': 'volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbead076-00b1-4b68-93b4-11850dd721ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbead076-00b1-4b68-93b4-11850dd721ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5688b1e-80d2-4108-9a1a-626703629fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:04:59 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Volume 0b7aeba4-efba-4b2a-9418-47b0fe48f133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133', 'volume_size': 1} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:04:59 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed 1G" returned: 0 in 0.906s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:04:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:00 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed Nov 04 19:05:00 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:00 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed" returned: 0 in 0.579s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:00 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed is being set with open permissions: ugo+rw Nov 04 19:05:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:00 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed Nov 04 19:05:00 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:00 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed" returned: 0 in 0.284s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:00 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.info Nov 04 19:05:00 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:01 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.info" returned: 0 in 0.341s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:01 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.info is being set with open permissions: ugo+rw Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:01 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.info Nov 04 19:05:01 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:01 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.info" returned: 0 in 0.286s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.109s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.174s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-458013181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7aeba4-efba-4b2a-9418-47b0fe48f133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f994e1a5ff43d1bb3805866c0a5d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:04:59Z,use_quota=True,user_id='caea5ed8f3114862afa2c2c1442fbf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Creating volume 0b7aeba4-efba-4b2a-9418-47b0fe48f133 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:01 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:05:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:01 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133 1073741824 Nov 04 19:05:01 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d3fdbc37-5397-420d-a54d-a1fcccadc8fa tempest-TestStampPattern-1157282596 None] Create snapshot completed successfully Nov 04 19:05:02 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133 1073741824" returned: 0 in 0.645s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:02 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133 Nov 04 19:05:02 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:02 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133" returned: 0 in 0.420s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5688b1e-80d2-4108-9a1a-626703629fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86815b65-5645-4922-afb1-33bfb3d17c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:02 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Volume volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133 (0b7aeba4-efba-4b2a-9418-47b0fe48f133): created successfully Nov 04 19:05:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86815b65-5645-4922-afb1-33bfb3d17c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Flow 'volume_create_manager' (0fb6e999-1e24-420b-b920-0a47b5ef33d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b896d8f9-0a17-4eff-bb69-aafa99a9e6cd tempest-VolumesTransfersTest-113146626 None] Created volume successfully. Nov 04 19:05:04 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6f6a0bd1-ce60-4cfe-8e2d-34875caf1b5c tempest-VolumesTransfersTest-444269366 None] Transfer volume completed successfully. Nov 04 19:05:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Acquiring lock "cinder-0b7aeba4-efba-4b2a-9418-47b0fe48f133-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Lock "cinder-0b7aeba4-efba-4b2a-9418-47b0fe48f133-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Acquiring lock "cinder-quobyte-0b7aeba4-efba-4b2a-9418-47b0fe48f133" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Lock "cinder-quobyte-0b7aeba4-efba-4b2a-9418-47b0fe48f133" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:05 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e513e20e-1f58-424e-8de7-f4bc889b4c3b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:05 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133 Nov 04 19:05:05 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:05 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133" returned: 0 in 0.435s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:05 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133 Nov 04 19:05:05 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:05 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0b7aeba4-efba-4b2a-9418-47b0fe48f133" returned: 0 in 0.293s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Lock "cinder-quobyte-0b7aeba4-efba-4b2a-9418-47b0fe48f133" released by "delete_volume" :: held 0.799s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Created reservations ['dff7ad1e-c61f-4b53-9e53-c83bed856ada', 'b5ee5cb5-00d7-4380-bd3b-f49f7a22c83c', 'b9c8839f-7e83-4661-b7d2-0a48e7e132f2', '506cb9ad-1f4b-463d-bd00-f5280024014d'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:06 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:05:06 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:06 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.423s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:06 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Deleted volume successfully. Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d86e2e4b-b461-4c95-a910-47aeaf490da3 tempest-VolumesTransfersTest-1652734769 None] Lock "cinder-0b7aeba4-efba-4b2a-9418-47b0fe48f133-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Flow 'volume_create_manager' (08241ca2-940b-4dd0-80ec-1fb9820c06c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a339b71-ec9a-4ff0-aa41-f3e62e69951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a339b71-ec9a-4ff0-aa41-f3e62e69951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1890260059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e310d170-b6dd-4a31-99a8-a7394fc8a972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f994e1a5ff43d1bb3805866c0a5d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:07Z,use_quota=True,user_id='caea5ed8f3114862afa2c2c1442fbf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1da8587-5d7c-4c2a-92aa-c2845d5ec5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1da8587-5d7c-4c2a-92aa-c2845d5ec5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb30674-910b-459b-bd65-a4ce4303f3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb30674-910b-459b-bd65-a4ce4303f3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e310d170-b6dd-4a31-99a8-a7394fc8a972', 'volume_name': 'volume-e310d170-b6dd-4a31-99a8-a7394fc8a972', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b589f393-6a05-4b3f-abee-adf3e067f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b589f393-6a05-4b3f-abee-adf3e067f881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366ee538-ad91-4282-ba3f-c5aecda5be2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:06 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Volume e310d170-b6dd-4a31-99a8-a7394fc8a972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e310d170-b6dd-4a31-99a8-a7394fc8a972', 'volume_size': 1} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1890260059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e310d170-b6dd-4a31-99a8-a7394fc8a972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91f994e1a5ff43d1bb3805866c0a5d1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:07Z,use_quota=True,user_id='caea5ed8f3114862afa2c2c1442fbf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Creating volume e310d170-b6dd-4a31-99a8-a7394fc8a972 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:06 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:05:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:07 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972 1073741824 Nov 04 19:05:07 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:07 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972 1073741824" returned: 0 in 0.579s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:07 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972 Nov 04 19:05:07 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:07 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972" returned: 0 in 0.331s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366ee538-ad91-4282-ba3f-c5aecda5be2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e310d170-b6dd-4a31-99a8-a7394fc8a972', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af60350-acd7-4946-91a5-f307ccc69188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:07 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Volume volume-e310d170-b6dd-4a31-99a8-a7394fc8a972 (e310d170-b6dd-4a31-99a8-a7394fc8a972): created successfully Nov 04 19:05:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af60350-acd7-4946-91a5-f307ccc69188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:07 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Flow 'volume_create_manager' (08241ca2-940b-4dd0-80ec-1fb9820c06c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:08 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-92353745-e66c-402b-91b8-dfe19b3dd3ee tempest-VolumesTransfersTest-113146626 None] Created volume successfully. Nov 04 19:05:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Acquiring lock "cinder-e310d170-b6dd-4a31-99a8-a7394fc8a972-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Lock "cinder-e310d170-b6dd-4a31-99a8-a7394fc8a972-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Acquiring lock "cinder-quobyte-e310d170-b6dd-4a31-99a8-a7394fc8a972" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Lock "cinder-quobyte-e310d170-b6dd-4a31-99a8-a7394fc8a972" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:09 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2f5709-e506-47fb-a829-e492cde02e01]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:09 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972 Nov 04 19:05:09 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:09 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972" returned: 0 in 0.398s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:09 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972 Nov 04 19:05:09 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:10 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-e310d170-b6dd-4a31-99a8-a7394fc8a972" returned: 0 in 0.263s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Lock "cinder-quobyte-e310d170-b6dd-4a31-99a8-a7394fc8a972" released by "delete_volume" :: held 0.713s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Created reservations ['3718306c-151d-45b7-ad96-f2dd5500553a', 'b8cf600b-4c6d-4e51-be49-d2d0002ced97', '8fdbf0ad-e3de-4284-9085-2ddc87a231b5', '3063feca-ec35-4580-9144-0a8f0189ba44'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:10 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:05:10 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:10 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.309s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:10 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Deleted volume successfully. Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55eab9ea-b5d3-4b8a-92a1-29848b8ca6b1 tempest-VolumesTransfersTest-1652734769 None] Lock "cinder-e310d170-b6dd-4a31-99a8-a7394fc8a972-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:10 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Flow 'volume_create_manager' (cda8a619-b1f0-434b-b0f6-ee6150dd6b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9dbc80-d658-4f20-b465-b78d3641616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9dbc80-d658-4f20-b465-b78d3641616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-539022327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9fe193-9e2c-40a1-a8b5-ae810d102a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5948b70704de439b9c8a6dc68f0bc8b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6533ba9e-e70e-47ce-9aac-7998ac51ceed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:11Z,use_quota=True,user_id='0c7b6f6939214ff0b182062a4667ce91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64534fa6-d032-4509-9333-1d47bac5d5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64534fa6-d032-4509-9333-1d47bac5d5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f3d2b6-6a34-4efb-a918-c1acadf389c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f3d2b6-6a34-4efb-a918-c1acadf389c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac9fe193-9e2c-40a1-a8b5-ae810d102a05', 'volume_name': 'volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05', 'volume_size': 1, 'snapshot_id': '6533ba9e-e70e-47ce-9aac-7998ac51ceed'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4c8dc1-97ae-4b25-94c9-26afec47f238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4c8dc1-97ae-4b25-94c9-26afec47f238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447a5668-fa6c-4bf9-81d6-58161e953e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:11 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Volume ac9fe193-9e2c-40a1-a8b5-ae810d102a05: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05', 'volume_size': 1, 'snapshot_id': '6533ba9e-e70e-47ce-9aac-7998ac51ceed'} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Acquiring lock "cinder-quobyte-6533ba9e-e70e-47ce-9aac-7998ac51ceed-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" by "_create_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-6533ba9e-e70e-47ce-9aac-7998ac51ceed-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Creating volume ac9fe193-9e2c-40a1-a8b5-ae810d102a05 from snapshot 6533ba9e-e70e-47ce-9aac-7998ac51ceed {{(pid=87364) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Acquiring lock "cinder-quobyte-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] snapshot: 6533ba9e-e70e-47ce-9aac-7998ac51ceed, volume: ac9fe193-9e2c-40a1-a8b5-ae810d102a05, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40e34d6-3726-40bd-b620-f9078320342d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:11 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed Nov 04 19:05:11 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:11 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed" returned: 0 in 0.599s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95deddc9-1969-4436-be8e-0d2cb5aa2936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[382c9a51-342c-4436-a017-cd0186839ccb]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:12 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 Nov 04 19:05:12 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:12 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936" returned: 0 in 0.630s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:05:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:05:12 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:05:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:12 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 Nov 04 19:05:12 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Acquiring lock "cinder-be429f85-36b1-4c5d-882c-ed87bb5c7761-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Lock "cinder-be429f85-36b1-4c5d-882c-ed87bb5c7761-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Acquiring lock "cinder-quobyte-be429f85-36b1-4c5d-882c-ed87bb5c7761" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Lock "cinder-quobyte-be429f85-36b1-4c5d-882c-ed87bb5c7761" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:13 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[010eb332-79a3-4e7c-8f96-d9f605cb343a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:13 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761 Nov 04 19:05:13 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:14 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761" returned: 0 in 0.944s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:14 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761 Nov 04 19:05:14 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:14 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-be429f85-36b1-4c5d-882c-ed87bb5c7761" returned: 0 in 0.547s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Lock "cinder-quobyte-be429f85-36b1-4c5d-882c-ed87bb5c7761" released by "delete_volume" :: held 1.576s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:14 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Created reservations ['33231660-a1dc-443c-972e-404bb4320c5a', 'c233300b-c62f-48de-b846-dba7a6f57561', '21030177-a778-4ef5-9bd5-1b84de197120', '4af3cfe2-12cb-4ee2-ab67-9375f525b961'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:15 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:05:15 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:15 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.460s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:15 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:15 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Deleted volume successfully. Nov 04 19:05:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5bc24f3e-f67f-4390-ab40-8f370630c72f tempest-VolumesNegativeTest-1021668364 None] Lock "cinder-be429f85-36b1-4c5d-882c-ed87bb5c7761-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:05:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:16 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:05:16 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:16 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.796s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:17 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:17 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:05:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:05:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:05:22 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" returned: 0 in 10.361s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:22 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936, size 1024.00 MB, duration 10.36 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:05:22 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Converted 1024.00 MB image at 98.83 MB/s Nov 04 19:05:22 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 is being set with open permissions: ugo+rw Nov 04 19:05:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:22 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 Nov 04 19:05:22 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:23 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" returned: 0 in 0.527s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" released by "_copy_volume_from_snapshot" :: held 12.275s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-6533ba9e-e70e-47ce-9aac-7998ac51ceed-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" released by "_create_volume_from_snapshot" :: held 12.413s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.430s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447a5668-fa6c-4bf9-81d6-58161e953e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05', 'volume_size': 1, 'snapshot_id': '6533ba9e-e70e-47ce-9aac-7998ac51ceed'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8af5a6-dd2f-4843-b244-cdbdfcc185c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:23 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Volume volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 (ac9fe193-9e2c-40a1-a8b5-ae810d102a05): created successfully Nov 04 19:05:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8af5a6-dd2f-4843-b244-cdbdfcc185c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Flow 'volume_create_manager' (cda8a619-b1f0-434b-b0f6-ee6150dd6b16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:23 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5ddc0c09-8ae9-48dc-a79e-56be568a8c64 tempest-TestStampPattern-1157282596 None] Created volume successfully. Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Flow 'volume_create_manager' (5cd1a1b3-dbed-466c-b346-fc5687dfa5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb2cf56-535f-4b4b-8112-a558c34bc93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb2cf56-535f-4b4b-8112-a558c34bc93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-349743748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e37262b-0a9c-4cd6-8d15-ab3d517807d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b86c02b3245aeae0b439dbb7ed9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:29Z,use_quota=True,user_id='219fbe7a4361404c9a557be11fd64d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343a0a04-1338-43c4-829b-e781f358ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343a0a04-1338-43c4-829b-e781f358ce09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac5dac4-ac82-4325-81f7-022586d5a95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac5dac4-ac82-4325-81f7-022586d5a95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e37262b-0a9c-4cd6-8d15-ab3d517807d6', 'volume_name': 'volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb09ccf-82c1-4dc5-80b7-8d5b5ac86fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb09ccf-82c1-4dc5-80b7-8d5b5ac86fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174e0f10-f4ae-463c-86f8-34c9016258d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:29 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Volume 3e37262b-0a9c-4cd6-8d15-ab3d517807d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6', 'volume_size': 1} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-349743748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e37262b-0a9c-4cd6-8d15-ab3d517807d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b86c02b3245aeae0b439dbb7ed9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:29Z,use_quota=True,user_id='219fbe7a4361404c9a557be11fd64d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Creating volume 3e37262b-0a9c-4cd6-8d15-ab3d517807d6 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:29 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:29 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6 1073741824 Nov 04 19:05:29 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:29 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6 1073741824" returned: 0 in 0.770s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:30 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6 Nov 04 19:05:30 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:30 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6" returned: 0 in 0.379s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174e0f10-f4ae-463c-86f8-34c9016258d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a3036f-74fb-41af-afc4-b2672af2a7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:30 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Volume volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6 (3e37262b-0a9c-4cd6-8d15-ab3d517807d6): created successfully Nov 04 19:05:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a3036f-74fb-41af-afc4-b2672af2a7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:30 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Flow 'volume_create_manager' (5cd1a1b3-dbed-466c-b346-fc5687dfa5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:30 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-874b3f32-0b7f-427f-b2ac-19bf5bdcd80f tempest-VolumesTransfersV355Test-1521970701 None] Created volume successfully. Nov 04 19:05:32 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-eda69ccc-1e0f-4e81-a9aa-69cb1590f8cf tempest-VolumesTransfersV355Test-666687445 None] Transfer volume completed successfully. Nov 04 19:05:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Acquiring lock "cinder-3e37262b-0a9c-4cd6-8d15-ab3d517807d6-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Lock "cinder-3e37262b-0a9c-4cd6-8d15-ab3d517807d6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Acquiring lock "cinder-quobyte-3e37262b-0a9c-4cd6-8d15-ab3d517807d6" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Lock "cinder-quobyte-3e37262b-0a9c-4cd6-8d15-ab3d517807d6" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:33 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39c926-c899-4341-b234-a6102827eb14]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:33 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6 Nov 04 19:05:33 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:33 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6" returned: 0 in 0.681s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:34 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6 Nov 04 19:05:34 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:34 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3e37262b-0a9c-4cd6-8d15-ab3d517807d6" returned: 0 in 0.447s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Lock "cinder-quobyte-3e37262b-0a9c-4cd6-8d15-ab3d517807d6" released by "delete_volume" :: held 1.198s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:34 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Created reservations ['d30862ce-dbb0-47b1-b7e2-82697610b726', 'b80ff2fa-c076-4f85-a12d-71352cdd0888', '767396fe-82de-46c0-bd05-4a17559fd9d1', 'b9fd4547-2990-4e86-aa06-d6604731bf5e'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:34 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:05:34 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:34 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.292s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:34 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:34 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Deleted volume successfully. Nov 04 19:05:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-66abc88f-a396-48ae-8846-29abe1c15bcf tempest-VolumesTransfersV355Test-1432275878 None] Lock "cinder-3e37262b-0a9c-4cd6-8d15-ab3d517807d6-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Flow 'volume_create_manager' (8bc8b142-ae10-4eb9-a837-fd65c1302c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1549b5ff-55b7-4a09-b638-b974cd99859c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1549b5ff-55b7-4a09-b638-b974cd99859c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1134397205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc21c87e-e937-447b-8772-7afdaa5a808f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b86c02b3245aeae0b439dbb7ed9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:36Z,use_quota=True,user_id='219fbe7a4361404c9a557be11fd64d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c8f65c-6c0a-48b3-adb6-f3f7294fe99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c8f65c-6c0a-48b3-adb6-f3f7294fe99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897e816f-6ec9-46fc-9076-96a4c0ff09d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897e816f-6ec9-46fc-9076-96a4c0ff09d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc21c87e-e937-447b-8772-7afdaa5a808f', 'volume_name': 'volume-dc21c87e-e937-447b-8772-7afdaa5a808f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecba82c-2803-45b4-9a96-0b1af9f34727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecba82c-2803-45b4-9a96-0b1af9f34727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8b3a3d-93b7-4aca-bb55-3a53f3dd17da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:36 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Volume dc21c87e-e937-447b-8772-7afdaa5a808f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc21c87e-e937-447b-8772-7afdaa5a808f', 'volume_size': 1} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1134397205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc21c87e-e937-447b-8772-7afdaa5a808f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b86c02b3245aeae0b439dbb7ed9cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:36Z,use_quota=True,user_id='219fbe7a4361404c9a557be11fd64d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Creating volume dc21c87e-e937-447b-8772-7afdaa5a808f {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:36 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:05:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:36 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f 1073741824 Nov 04 19:05:36 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:37 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f 1073741824" returned: 0 in 0.684s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:37 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f Nov 04 19:05:37 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:37 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f" returned: 0 in 0.293s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8b3a3d-93b7-4aca-bb55-3a53f3dd17da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc21c87e-e937-447b-8772-7afdaa5a808f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3799c7-9c21-4645-acfb-83e2d271c9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:37 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Volume volume-dc21c87e-e937-447b-8772-7afdaa5a808f (dc21c87e-e937-447b-8772-7afdaa5a808f): created successfully Nov 04 19:05:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3799c7-9c21-4645-acfb-83e2d271c9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Flow 'volume_create_manager' (8bc8b142-ae10-4eb9-a837-fd65c1302c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6db11da2-03ef-4b6f-97de-d368c6817eb2 tempest-VolumesTransfersV355Test-1521970701 None] Created volume successfully. Nov 04 19:05:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Acquiring lock "cinder-dc21c87e-e937-447b-8772-7afdaa5a808f-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Lock "cinder-dc21c87e-e937-447b-8772-7afdaa5a808f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Acquiring lock "cinder-quobyte-dc21c87e-e937-447b-8772-7afdaa5a808f" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:05:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Lock "cinder-quobyte-dc21c87e-e937-447b-8772-7afdaa5a808f" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:05:38 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b3ce4a-566e-4031-b061-756ad463fb9a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:05:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:38 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f Nov 04 19:05:38 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:39 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f" returned: 0 in 0.418s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:39 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f Nov 04 19:05:39 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:39 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dc21c87e-e937-447b-8772-7afdaa5a808f" returned: 0 in 0.311s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:39 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Lock "cinder-quobyte-dc21c87e-e937-447b-8772-7afdaa5a808f" released by "delete_volume" :: held 0.781s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:39 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Created reservations ['c2921d55-3a50-4c9e-bcd0-56be2efee8c2', 'a78da91c-fd98-487a-930a-7c7c0efe7140', '5772088d-132e-4531-8e92-40147fcafb91', 'c50cff68-05fa-40d2-9983-9d2b889d997a'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:05:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:39 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:05:39 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:40 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.303s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:40 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:05:40 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Deleted volume successfully. Nov 04 19:05:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7a62c929-71b3-4dd5-848d-a16c945a158f tempest-VolumesTransfersV355Test-1432275878 None] Lock "cinder-dc21c87e-e937-447b-8772-7afdaa5a808f-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:05:49 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=44,cinder:UPDATE=54,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:05:50 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=60,cinder:SELECT=39,cinder:INSERT=11,cinder:DELETE=6 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Flow 'volume_create_manager' (b1ad3e1d-8ba1-47db-9051-884f2a778493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d754e9b-86ef-41a7-b0f4-778e3073d901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d754e9b-86ef-41a7-b0f4-778e3073d901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-731322536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c097858-0466-4f85-9bb5-4cbd0dc61b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceec099876d4233904ab21829465be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:53Z,use_quota=True,user_id='695440c9ff6c4625af8beff994f5a244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e2fa90-05dc-46ec-a2fe-34046993c2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e2fa90-05dc-46ec-a2fe-34046993c2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eff98aa-f230-40be-9aec-7c0b62364f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eff98aa-f230-40be-9aec-7c0b62364f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c097858-0466-4f85-9bb5-4cbd0dc61b57', 'volume_name': 'volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79062588-9760-4ad7-a5f4-6b798856345c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79062588-9760-4ad7-a5f4-6b798856345c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e0612b-53f4-4735-a835-e2ef03a1fb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:52 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Volume 4c097858-0466-4f85-9bb5-4cbd0dc61b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57', 'volume_size': 1} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-731322536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c097858-0466-4f85-9bb5-4cbd0dc61b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceec099876d4233904ab21829465be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:53Z,use_quota=True,user_id='695440c9ff6c4625af8beff994f5a244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Creating volume 4c097858-0466-4f85-9bb5-4cbd0dc61b57 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:52 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:05:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:53 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57 1073741824 Nov 04 19:05:53 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Flow 'volume_create_manager' (16253a9d-ae64-4977-9900-f52215e51d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9608c728-49ca-4e4c-8121-f350659a8b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9608c728-49ca-4e4c-8121-f350659a8b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-835044702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b7f10a-5e36-459d-a609-7d76a3750e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceec099876d4233904ab21829465be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:53Z,use_quota=True,user_id='695440c9ff6c4625af8beff994f5a244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf4533f-245b-4b8e-a02c-6973e6f0816e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf4533f-245b-4b8e-a02c-6973e6f0816e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c9cdce-b86b-47de-aa5a-a6d86fdead1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c9cdce-b86b-47de-aa5a-a6d86fdead1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b7f10a-5e36-459d-a609-7d76a3750e8c', 'volume_name': 'volume-32b7f10a-5e36-459d-a609-7d76a3750e8c', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c746fc63-f314-4260-a03e-f5cbee0f90f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c746fc63-f314-4260-a03e-f5cbee0f90f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da56ef80-e6a0-4097-87b0-00535626d5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:53 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Volume 32b7f10a-5e36-459d-a609-7d76a3750e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b7f10a-5e36-459d-a609-7d76a3750e8c', 'volume_size': 1} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:53 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57 1073741824" returned: 0 in 0.730s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:53 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57 Nov 04 19:05:53 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:54 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57" returned: 0 in 0.273s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-835044702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b7f10a-5e36-459d-a609-7d76a3750e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceec099876d4233904ab21829465be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:05:53Z,use_quota=True,user_id='695440c9ff6c4625af8beff994f5a244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Creating volume 32b7f10a-5e36-459d-a609-7d76a3750e8c {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:05:54 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e0612b-53f4-4735-a835-e2ef03a1fb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (face8361-8776-4526-8cb2-16cd23c5aca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:54 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c 1073741824 Nov 04 19:05:54 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:54 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Volume volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57 (4c097858-0466-4f85-9bb5-4cbd0dc61b57): created successfully Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (face8361-8776-4526-8cb2-16cd23c5aca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Flow 'volume_create_manager' (b1ad3e1d-8ba1-47db-9051-884f2a778493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9ad19486-91c6-4072-a45d-c3f9841fa220 tempest-TestServerVolumeAttachmentScenario-730839684 None] Created volume successfully. Nov 04 19:05:54 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c 1073741824" returned: 0 in 0.599s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:05:54 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c Nov 04 19:05:54 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:05:54 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c" returned: 0 in 0.306s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:05:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da56ef80-e6a0-4097-87b0-00535626d5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b7f10a-5e36-459d-a609-7d76a3750e8c', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2a563c-0382-4c7b-a0ea-d5f626286751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:05:55 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Volume volume-32b7f10a-5e36-459d-a609-7d76a3750e8c (32b7f10a-5e36-459d-a609-7d76a3750e8c): created successfully Nov 04 19:05:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2a563c-0382-4c7b-a0ea-d5f626286751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:05:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Flow 'volume_create_manager' (16253a9d-ae64-4977-9900-f52215e51d17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:05:55 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-cf066b6c-b23d-4f5a-aa45-c9cebc1ada77 tempest-TestServerVolumeAttachmentScenario-730839684 None] Created volume successfully. Nov 04 19:05:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-eb3df162-6db2-454e-8e6f-31c738d19d42 req-4a52a503-a234-493c-92c9-fdac36f543b2 tempest-TestStampPattern-1157282596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:05:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-eb3df162-6db2-454e-8e6f-31c738d19d42 req-4a52a503-a234-493c-92c9-fdac36f543b2 tempest-TestStampPattern-1157282596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:05:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-eb3df162-6db2-454e-8e6f-31c738d19d42 req-4a52a503-a234-493c-92c9-fdac36f543b2 tempest-TestStampPattern-1157282596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:05:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-eb3df162-6db2-454e-8e6f-31c738d19d42 req-4a52a503-a234-493c-92c9-fdac36f543b2 tempest-TestStampPattern-1157282596 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce4c248b-3b0a-4234-b8f1-8dce3dc257c7', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:05:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-eb3df162-6db2-454e-8e6f-31c738d19d42 req-4a52a503-a234-493c-92c9-fdac36f543b2 tempest-TestStampPattern-1157282596 None] attachment_update completed successfully. Nov 04 19:06:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-2309db94-45ca-4ca0-9779-de258df0bf27 req-044ca9fb-fc56-4b30-b21b-56d51d85fe45 tempest-TestStampPattern-1157282596 None] Terminate volume connection completed successfully. Nov 04 19:06:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-2309db94-45ca-4ca0-9779-de258df0bf27 req-044ca9fb-fc56-4b30-b21b-56d51d85fe45 tempest-TestStampPattern-1157282596 None] Deleting attachment ce4c248b-3b0a-4234-b8f1-8dce3dc257c7. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:06:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Acquiring lock "cinder-ac9fe193-9e2c-40a1-a8b5-ae810d102a05-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Lock "cinder-ac9fe193-9e2c-40a1-a8b5-ae810d102a05-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Acquiring lock "cinder-quobyte-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:07 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6b42e9-69c0-4c22-af9c-cf12868ae99b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:07 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 Nov 04 19:06:07 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:08 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" returned: 0 in 0.580s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:08 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05 Nov 04 19:06:08 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:08 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" returned: 0 in 0.429s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-ac9fe193-9e2c-40a1-a8b5-ae810d102a05" released by "delete_volume" :: held 1.093s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:08 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Created reservations ['ce51ec5b-16bd-40d1-9c1a-7a0c2e7d595c', '93c400d2-3d77-4b9a-8421-f64cb2fed160', '6439eac7-7dec-4a6b-bcca-9da29cee2624', 'e003e8b3-8341-4c02-bdc3-eeea42dd6438'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:09 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:09 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:09 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:06:09 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:09 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.399s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:09 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:09 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Deleted volume successfully. Nov 04 19:06:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-55015e11-3db3-4477-bb6c-c781d10cc902 tempest-TestStampPattern-1157282596 None] Lock "cinder-ac9fe193-9e2c-40a1-a8b5-ae810d102a05-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Acquiring lock "cinder-6533ba9e-e70e-47ce-9aac-7998ac51ceed-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Lock "cinder-6533ba9e-e70e-47ce-9aac-7998ac51ceed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Acquiring lock "cinder-quobyte-95deddc9-1969-4436-be8e-0d2cb5aa2936" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-95deddc9-1969-4436-be8e-0d2cb5aa2936" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Acquiring lock "cinder-quobyte-6533ba9e-e70e-47ce-9aac-7998ac51ceed" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-6533ba9e-e70e-47ce-9aac-7998ac51ceed" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Deleting offline snapshot 6533ba9e-e70e-47ce-9aac-7998ac51ceed of volume 95deddc9-1969-4436-be8e-0d2cb5aa2936 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:06:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] snapshot_file for this snap is: volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:06:10 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffd17ab-4a7d-4026-b60a-47fb8d34ca6c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:10 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed Nov 04 19:06:10 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:11 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed" returned: 0 in 0.562s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95deddc9-1969-4436-be8e-0d2cb5aa2936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:06:11 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a97d29-1c6c-48bf-b3d1-023dac940de1]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:11 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 Nov 04 19:06:11 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:12 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936" returned: 0 in 0.942s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:12 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed Nov 04 19:06:12 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:12 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed" returned: 0 in 0.529s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:12 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed Nov 04 19:06:12 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:13 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936.6533ba9e-e70e-47ce-9aac-7998ac51ceed" returned: 0 in 0.392s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-6533ba9e-e70e-47ce-9aac-7998ac51ceed" released by "_delete_snapshot" :: held 2.638s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-95deddc9-1969-4436-be8e-0d2cb5aa2936" released by "delete_snapshot" :: held 2.683s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:13 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Created reservations ['f73a96b5-adf7-449d-b285-fa6877fd97af', 'b75a6360-5ae9-4e62-a1e9-9ecf80aa7066', '55714837-c727-4c08-a61e-cdc7768a2f81', 'edb9f62d-962e-465d-8ba2-b839ca4715c7'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:13 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Delete snapshot completed successfully. Nov 04 19:06:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-58de0a0c-f00f-4e81-b42d-b706a5be1a01 tempest-TestStampPattern-1157282596 None] Lock "cinder-6533ba9e-e70e-47ce-9aac-7998ac51ceed-delete_snapshot" released by "delete_snapshot" :: held 2.936s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:16 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:06:16 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:16 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.461s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:06:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:06:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Acquiring lock "cinder-95deddc9-1969-4436-be8e-0d2cb5aa2936-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Lock "cinder-95deddc9-1969-4436-be8e-0d2cb5aa2936-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Acquiring lock "cinder-quobyte-95deddc9-1969-4436-be8e-0d2cb5aa2936" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-95deddc9-1969-4436-be8e-0d2cb5aa2936" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:18 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30f79a8-18bd-4047-9224-6a4545354610]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:19 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 Nov 04 19:06:19 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:19 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936" returned: 0 in 0.480s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:19 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936 Nov 04 19:06:19 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:19 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-95deddc9-1969-4436-be8e-0d2cb5aa2936" returned: 0 in 0.271s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Lock "cinder-quobyte-95deddc9-1969-4436-be8e-0d2cb5aa2936" released by "delete_volume" :: held 0.862s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:19 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Created reservations ['ea83af86-da8a-4db5-80c4-3140e2c32c0a', '899861b6-6480-4eea-b5f5-9d4a5e8d4949', 'cbac9e3a-0be1-41e0-8b9c-20bc4ab3c904', '04be97f3-9ddc-4915-9b8d-e48af55e0e9d'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:19 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:06:19 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:20 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.277s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:20 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:20 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Deleted volume successfully. Nov 04 19:06:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73b1502c-77c4-47d7-a801-0da02e26bc35 tempest-TestStampPattern-1157282596 None] Lock "cinder-95deddc9-1969-4436-be8e-0d2cb5aa2936-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Flow 'volume_create_manager' (e89c428f-5eeb-4c2e-97c8-d9f003e79df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace249e9-7c21-4d3a-a140-59ffbd3213a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace249e9-7c21-4d3a-a140-59ffbd3213a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1953764821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf79e0c0-58af-4d79-93e7-81ed20084186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba3e923e6ab4566b6eedc1386211c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:30Z,use_quota=True,user_id='a921fa3c511b42c089d8f2ea336aab1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b275a413-e5a4-4d8b-a92a-3f5fb499dd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b275a413-e5a4-4d8b-a92a-3f5fb499dd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d85fa5b-822e-4751-9b05-9d7927b8ad28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d85fa5b-822e-4751-9b05-9d7927b8ad28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf79e0c0-58af-4d79-93e7-81ed20084186', 'volume_name': 'volume-cf79e0c0-58af-4d79-93e7-81ed20084186', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f3a8bf-e453-4ce8-a432-9f019e8a8a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f3a8bf-e453-4ce8-a432-9f019e8a8a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb1ba73-db1c-4f07-bf05-552bc8d67177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:29 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Volume cf79e0c0-58af-4d79-93e7-81ed20084186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf79e0c0-58af-4d79-93e7-81ed20084186', 'volume_size': 1} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1953764821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf79e0c0-58af-4d79-93e7-81ed20084186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba3e923e6ab4566b6eedc1386211c0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:30Z,use_quota=True,user_id='a921fa3c511b42c089d8f2ea336aab1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Creating volume cf79e0c0-58af-4d79-93e7-81ed20084186 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:29 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:06:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:29 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186 1073741824 Nov 04 19:06:29 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:30 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186 1073741824" returned: 0 in 0.842s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:30 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186 Nov 04 19:06:30 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:30 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186" returned: 0 in 0.372s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb1ba73-db1c-4f07-bf05-552bc8d67177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf79e0c0-58af-4d79-93e7-81ed20084186', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2eecce-853b-4bad-be87-53a1fb386ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:31 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Volume volume-cf79e0c0-58af-4d79-93e7-81ed20084186 (cf79e0c0-58af-4d79-93e7-81ed20084186): created successfully Nov 04 19:06:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2eecce-853b-4bad-be87-53a1fb386ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Flow 'volume_create_manager' (e89c428f-5eeb-4c2e-97c8-d9f003e79df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:31 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-25a78424-a0c9-4207-9636-0b7ddf8fd221 tempest-TestMinimumBasicScenario-2109964456 None] Created volume successfully. Nov 04 19:06:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-e419577c-dd76-4388-a4d5-2f0cdb8d1c8a req-7dbab382-33c5-45e5-ae13-95fbc2642093 tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-e419577c-dd76-4388-a4d5-2f0cdb8d1c8a req-7dbab382-33c5-45e5-ae13-95fbc2642093 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-e419577c-dd76-4388-a4d5-2f0cdb8d1c8a req-7dbab382-33c5-45e5-ae13-95fbc2642093 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-e419577c-dd76-4388-a4d5-2f0cdb8d1c8a req-7dbab382-33c5-45e5-ae13-95fbc2642093 tempest-TestServerVolumeAttachmentScenario-730839684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bf151c5-2af0-4d44-9801-b77ceb465322', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:06:32 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-e419577c-dd76-4388-a4d5-2f0cdb8d1c8a req-7dbab382-33c5-45e5-ae13-95fbc2642093 tempest-TestServerVolumeAttachmentScenario-730839684 None] attachment_update completed successfully. Nov 04 19:06:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-613cc267-04d4-49b3-9947-a0ec2c8ce280 req-f20d2f24-0673-4fd5-88a6-2835e1bf6970 tempest-TestMinimumBasicScenario-2109964456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-613cc267-04d4-49b3-9947-a0ec2c8ce280 req-f20d2f24-0673-4fd5-88a6-2835e1bf6970 tempest-TestMinimumBasicScenario-2109964456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-613cc267-04d4-49b3-9947-a0ec2c8ce280 req-f20d2f24-0673-4fd5-88a6-2835e1bf6970 tempest-TestMinimumBasicScenario-2109964456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-613cc267-04d4-49b3-9947-a0ec2c8ce280 req-f20d2f24-0673-4fd5-88a6-2835e1bf6970 tempest-TestMinimumBasicScenario-2109964456 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-cf79e0c0-58af-4d79-93e7-81ed20084186', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e46921d-375e-4ba0-a4f2-63f93a81ee08', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:06:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-613cc267-04d4-49b3-9947-a0ec2c8ce280 req-f20d2f24-0673-4fd5-88a6-2835e1bf6970 tempest-TestMinimumBasicScenario-2109964456 None] attachment_update completed successfully. Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Flow 'volume_create_manager' (d7f6bd0c-03ea-41be-a675-62321d3c2ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee21978-8e06-441c-a843-09d0f0b57d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee21978-8e06-441c-a843-09d0f0b57d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-115563583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b82a6a-b9fb-4008-b40e-68fc2723c8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1309a0797d74ced88f68c74f45bca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:39Z,use_quota=True,user_id='053c87afacbc4e89b09fe02d47394b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f0e33f-b7e3-48f2-8766-e355d81ec126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f0e33f-b7e3-48f2-8766-e355d81ec126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f1a51-ab6d-4fd3-89bf-eb6517e8960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f85f1a51-ab6d-4fd3-89bf-eb6517e8960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78b82a6a-b9fb-4008-b40e-68fc2723c8bb', 'volume_name': 'volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b600af7b-30e5-41de-a98f-597d18ff4245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b600af7b-30e5-41de-a98f-597d18ff4245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de6c604-cfe7-43d2-a9eb-26fdb3be63d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:39 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Volume 78b82a6a-b9fb-4008-b40e-68fc2723c8bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb', 'volume_size': 1} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-115563583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b82a6a-b9fb-4008-b40e-68fc2723c8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1309a0797d74ced88f68c74f45bca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:39Z,use_quota=True,user_id='053c87afacbc4e89b09fe02d47394b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Creating volume 78b82a6a-b9fb-4008-b40e-68fc2723c8bb {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:39 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:39 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb 1073741824 Nov 04 19:06:39 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-30c9232a-c8bc-4160-ace4-c8f58bd87de0 req-bc3a218a-2a15-4a9d-ab67-0d0822aa8e09 tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:39 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Flow 'volume_create_manager' (c162b835-2f27-467a-b9b4-3646afbf62f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b0e703-20bd-4d35-b4ee-816af6562a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b0e703-20bd-4d35-b4ee-816af6562a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453936098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8048e260-37aa-4217-a3ee-3a3f93bff208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1309a0797d74ced88f68c74f45bca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:40Z,use_quota=True,user_id='053c87afacbc4e89b09fe02d47394b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7aa674-46eb-4614-99ad-e3426970d09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7aa674-46eb-4614-99ad-e3426970d09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c942a13-ec45-4f3f-92c3-c051593f97c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c942a13-ec45-4f3f-92c3-c051593f97c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8048e260-37aa-4217-a3ee-3a3f93bff208', 'volume_name': 'volume-8048e260-37aa-4217-a3ee-3a3f93bff208', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be71b052-7056-4a5f-bfcb-7c2e20525d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be71b052-7056-4a5f-bfcb-7c2e20525d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68422271-e12e-43b9-9ee2-d6404443427c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:40 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Volume 8048e260-37aa-4217-a3ee-3a3f93bff208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8048e260-37aa-4217-a3ee-3a3f93bff208', 'volume_size': 1} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:40 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb 1073741824" returned: 0 in 0.898s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:40 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb Nov 04 19:06:40 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Flow 'volume_create_manager' (20416a2f-de26-42b1-8bc3-0c1f8e7df0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9049f9c0-5a4d-4181-9c58-2ab49037cdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:40 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9049f9c0-5a4d-4181-9c58-2ab49037cdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1941542371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc7065a-5275-4d9e-b2c5-1a79e345574b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1309a0797d74ced88f68c74f45bca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:41Z,use_quota=True,user_id='053c87afacbc4e89b09fe02d47394b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69fb5b5e-0f87-4b85-ba39-c5e70ec5fa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69fb5b5e-0f87-4b85-ba39-c5e70ec5fa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2311c4-1cc1-4a27-bb3f-57c330e8d8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2311c4-1cc1-4a27-bb3f-57c330e8d8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc7065a-5275-4d9e-b2c5-1a79e345574b', 'volume_name': 'volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d76dc89-2fe0-465a-b774-c9ed3a64990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d76dc89-2fe0-465a-b774-c9ed3a64990c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13a2971-9f76-49c1-b749-3d10f1970004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:40 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Volume 2fc7065a-5275-4d9e-b2c5-1a79e345574b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b', 'volume_size': 1} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb" returned: 0 in 0.691s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-30c9232a-c8bc-4160-ace4-c8f58bd87de0 req-bc3a218a-2a15-4a9d-ab67-0d0822aa8e09 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.411s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-30c9232a-c8bc-4160-ace4-c8f58bd87de0 req-bc3a218a-2a15-4a9d-ab67-0d0822aa8e09 tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453936098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8048e260-37aa-4217-a3ee-3a3f93bff208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1309a0797d74ced88f68c74f45bca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:40Z,use_quota=True,user_id='053c87afacbc4e89b09fe02d47394b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Creating volume 8048e260-37aa-4217-a3ee-3a3f93bff208 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:40 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de6c604-cfe7-43d2-a9eb-26fdb3be63d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529697cf-bb96-4e90-baaa-0fef62bc2677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:41 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208 1073741824 Nov 04 19:06:41 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:41 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Volume volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb (78b82a6a-b9fb-4008-b40e-68fc2723c8bb): created successfully Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529697cf-bb96-4e90-baaa-0fef62bc2677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Flow 'volume_create_manager' (d7f6bd0c-03ea-41be-a675-62321d3c2ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3394f8ec-3dd1-423f-aa7a-876c49cc588b tempest-CreateVolumesFromImageTest-611829995 None] Created volume successfully. Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-30c9232a-c8bc-4160-ace4-c8f58bd87de0 req-bc3a218a-2a15-4a9d-ab67-0d0822aa8e09 tempest-TestServerVolumeAttachmentScenario-730839684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-32b7f10a-5e36-459d-a609-7d76a3750e8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '827a2cfb-2aef-42c8-b741-8a017ad8b2e0', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:06:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-30c9232a-c8bc-4160-ace4-c8f58bd87de0 req-bc3a218a-2a15-4a9d-ab67-0d0822aa8e09 tempest-TestServerVolumeAttachmentScenario-730839684 None] attachment_update completed successfully. Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Flow 'volume_create_manager' (281091df-9f75-44b8-a73b-4814a6871a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9bda84-4004-4f22-96e1-25df64cbf45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9bda84-4004-4f22-96e1-25df64cbf45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849510682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffc3436-8498-4fb4-92fe-09d10cf6bdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1309a0797d74ced88f68c74f45bca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:42Z,use_quota=True,user_id='053c87afacbc4e89b09fe02d47394b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56f4613-6009-4b01-badd-3c5c43eb2a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56f4613-6009-4b01-badd-3c5c43eb2a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca777ea-93b4-45b7-bbb2-8f7bcbf89727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca777ea-93b4-45b7-bbb2-8f7bcbf89727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cffc3436-8498-4fb4-92fe-09d10cf6bdfc', 'volume_name': 'volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e01322-d83f-4f72-9484-c3cadac99c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e01322-d83f-4f72-9484-c3cadac99c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd41dc3-2791-4ee1-a41b-96dfd04ea009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:41 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Volume cffc3436-8498-4fb4-92fe-09d10cf6bdfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc', 'volume_size': 1} Nov 04 19:06:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:42 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208 1073741824" returned: 0 in 1.102s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:42 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208 Nov 04 19:06:42 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Flow 'volume_create_manager' (0a3f436a-c373-426f-ad2c-78d9d3cdf5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbd6f41-83be-46a2-ab26-d3430e84a1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbd6f41-83be-46a2-ab26-d3430e84a1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523707423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cbf1ea-9468-4fee-9601-94ab4c0778be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1309a0797d74ced88f68c74f45bca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:42Z,use_quota=True,user_id='053c87afacbc4e89b09fe02d47394b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1836cf1-1c4f-46d5-a7bb-b58ffa8d52c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1836cf1-1c4f-46d5-a7bb-b58ffa8d52c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01f18aa-a591-40fd-a4a8-0917be5ae899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01f18aa-a591-40fd-a4a8-0917be5ae899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05cbf1ea-9468-4fee-9601-94ab4c0778be', 'volume_name': 'volume-05cbf1ea-9468-4fee-9601-94ab4c0778be', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59748317-fa6d-45e8-91ea-c4913602ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59748317-fa6d-45e8-91ea-c4913602ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc77a7f7-1074-45fa-9858-83ec2df896b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:42 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Volume 05cbf1ea-9468-4fee-9601-94ab4c0778be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05cbf1ea-9468-4fee-9601-94ab4c0778be', 'volume_size': 1} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:42 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208" returned: 0 in 0.297s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1941542371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc7065a-5275-4d9e-b2c5-1a79e345574b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1309a0797d74ced88f68c74f45bca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:41Z,use_quota=True,user_id='053c87afacbc4e89b09fe02d47394b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Creating volume 2fc7065a-5275-4d9e-b2c5-1a79e345574b {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:42 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68422271-e12e-43b9-9ee2-d6404443427c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8048e260-37aa-4217-a3ee-3a3f93bff208', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:42 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b 1073741824 Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7e4549-d8c9-4874-981b-8e78f9a9447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:42 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:42 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Volume volume-8048e260-37aa-4217-a3ee-3a3f93bff208 (8048e260-37aa-4217-a3ee-3a3f93bff208): created successfully Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7e4549-d8c9-4874-981b-8e78f9a9447c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Flow 'volume_create_manager' (c162b835-2f27-467a-b9b4-3646afbf62f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-377cfc47-d273-4337-8b8d-a76b04ac8660 tempest-CreateVolumesFromImageTest-611829995 None] Created volume successfully. Nov 04 19:06:43 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b 1073741824" returned: 0 in 0.588s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:43 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b Nov 04 19:06:43 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:43 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b" returned: 0 in 0.330s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849510682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffc3436-8498-4fb4-92fe-09d10cf6bdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1309a0797d74ced88f68c74f45bca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:42Z,use_quota=True,user_id='053c87afacbc4e89b09fe02d47394b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Creating volume cffc3436-8498-4fb4-92fe-09d10cf6bdfc {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:43 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13a2971-9f76-49c1-b749-3d10f1970004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:43 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc 1073741824 Nov 04 19:06:43 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4df267-d968-4a99-8f65-5195e7c815ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:43 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Volume volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b (2fc7065a-5275-4d9e-b2c5-1a79e345574b): created successfully Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4df267-d968-4a99-8f65-5195e7c815ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Flow 'volume_create_manager' (20416a2f-de26-42b1-8bc3-0c1f8e7df0e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:43 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0db3b787-2c9d-4808-a09f-2540d4012213 tempest-CreateVolumesFromImageTest-611829995 None] Created volume successfully. Nov 04 19:06:43 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-0ce2aca7-11cf-4e0c-a115-07db7948dfda req-029782a3-3cdd-46d6-b15f-818c457a763f tempest-TestServerVolumeAttachmentScenario-730839684 None] Terminate volume connection completed successfully. Nov 04 19:06:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-0ce2aca7-11cf-4e0c-a115-07db7948dfda req-029782a3-3cdd-46d6-b15f-818c457a763f tempest-TestServerVolumeAttachmentScenario-730839684 None] Deleting attachment 827a2cfb-2aef-42c8-b741-8a017ad8b2e0. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:06:44 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc 1073741824" returned: 0 in 0.586s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:44 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc Nov 04 19:06:44 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:44 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc" returned: 0 in 0.263s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.968s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523707423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cbf1ea-9468-4fee-9601-94ab4c0778be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1309a0797d74ced88f68c74f45bca98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:06:42Z,use_quota=True,user_id='053c87afacbc4e89b09fe02d47394b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Creating volume 05cbf1ea-9468-4fee-9601-94ab4c0778be {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:06:44 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd41dc3-2791-4ee1-a41b-96dfd04ea009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9db84c5-4d88-41ce-92e0-a549134d723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:44 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be 1073741824 Nov 04 19:06:44 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:44 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Volume volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc (cffc3436-8498-4fb4-92fe-09d10cf6bdfc): created successfully Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9db84c5-4d88-41ce-92e0-a549134d723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Flow 'volume_create_manager' (281091df-9f75-44b8-a73b-4814a6871a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:44 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-866829ab-1522-48bb-b025-71d6aa9c1d11 tempest-CreateVolumesFromImageTest-611829995 None] Created volume successfully. Nov 04 19:06:45 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be 1073741824" returned: 0 in 0.671s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:45 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be Nov 04 19:06:45 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-5739d704-f374-4c15-9792-3f56d3cc4468 req-79ab816b-7436-4959-aeff-5008709172fe tempest-TestServerVolumeAttachmentScenario-730839684 None] Terminate volume connection completed successfully. Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-5739d704-f374-4c15-9792-3f56d3cc4468 req-79ab816b-7436-4959-aeff-5008709172fe tempest-TestServerVolumeAttachmentScenario-730839684 None] Deleting attachment 6bf151c5-2af0-4d44-9801-b77ceb465322. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:06:45 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be" returned: 0 in 0.361s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc77a7f7-1074-45fa-9858-83ec2df896b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05cbf1ea-9468-4fee-9601-94ab4c0778be', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c422f1-2ea7-4226-9a2b-ba48f03b4ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:06:45 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Volume volume-05cbf1ea-9468-4fee-9601-94ab4c0778be (05cbf1ea-9468-4fee-9601-94ab4c0778be): created successfully Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c422f1-2ea7-4226-9a2b-ba48f03b4ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Flow 'volume_create_manager' (0a3f436a-c373-426f-ad2c-78d9d3cdf5ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:06:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a611f449-72b5-42b2-98df-bcf68c6ccc85 tempest-CreateVolumesFromImageTest-611829995 None] Created volume successfully. Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "cinder-05cbf1ea-9468-4fee-9601-94ab4c0778be-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-05cbf1ea-9468-4fee-9601-94ab4c0778be-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "cinder-quobyte-05cbf1ea-9468-4fee-9601-94ab4c0778be" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-quobyte-05cbf1ea-9468-4fee-9601-94ab4c0778be" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[815e1e8f-0ffe-433f-8068-7212a5f7e63e]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be Nov 04 19:06:46 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be" returned: 0 in 0.377s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be Nov 04 19:06:46 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:46 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-05cbf1ea-9468-4fee-9601-94ab4c0778be" returned: 0 in 0.279s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:46 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-quobyte-05cbf1ea-9468-4fee-9601-94ab4c0778be" released by "delete_volume" :: held 0.711s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:46 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Created reservations ['b0646c9e-f746-4252-a532-d7e01ca4bc40', '85bf1c4c-30b6-4929-99f2-88adedf25291', '18fc8627-e516-42da-a682-2571bec76755', 'c6d05c24-7922-4a18-8073-369cc2d4d06a'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:46 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:06:46 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "cinder-cffc3436-8498-4fb4-92fe-09d10cf6bdfc-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-cffc3436-8498-4fb4-92fe-09d10cf6bdfc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "cinder-quobyte-cffc3436-8498-4fb4-92fe-09d10cf6bdfc" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-quobyte-cffc3436-8498-4fb4-92fe-09d10cf6bdfc" acquired by "delete_volume" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:47 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb4ed50-274f-4af7-9b50-ac6ef4071d24]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:47 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.447s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:47 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:47 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Deleted volume successfully. Nov 04 19:06:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-dad1b6d3-212d-404f-8921-e4e87cea1f54 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-05cbf1ea-9468-4fee-9601-94ab4c0778be-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:47 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc Nov 04 19:06:47 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:47 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc" returned: 0 in 0.579s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:47 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc Nov 04 19:06:47 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:48 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cffc3436-8498-4fb4-92fe-09d10cf6bdfc" returned: 0 in 0.359s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-quobyte-cffc3436-8498-4fb4-92fe-09d10cf6bdfc" released by "delete_volume" :: held 1.036s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Created reservations ['c8865eb1-57f0-4ac3-9c64-a6a2f92d8063', 'e92e7c8b-bbb6-4f2a-bdb2-eecb70756d8a', 'd1eeeb30-2538-4322-b819-02cdad6dbb62', 'cd260ad8-22ae-4c8e-b922-2266ac4abfc2'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:48 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:06:48 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:48 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.356s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:48 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Deleted volume successfully. Nov 04 19:06:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-01010244-44fd-40d3-ae77-a21004d2ff76 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-cffc3436-8498-4fb4-92fe-09d10cf6bdfc-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "cinder-2fc7065a-5275-4d9e-b2c5-1a79e345574b-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-2fc7065a-5275-4d9e-b2c5-1a79e345574b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "cinder-quobyte-2fc7065a-5275-4d9e-b2c5-1a79e345574b" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-quobyte-2fc7065a-5275-4d9e-b2c5-1a79e345574b" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:49 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe09b8c-2cc0-4b01-b8cf-fa790917c048]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:49 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b Nov 04 19:06:49 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:50 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b" returned: 0 in 0.489s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:50 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b Nov 04 19:06:50 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:50 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2fc7065a-5275-4d9e-b2c5-1a79e345574b" returned: 0 in 0.410s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-quobyte-2fc7065a-5275-4d9e-b2c5-1a79e345574b" released by "delete_volume" :: held 0.958s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=73,cinder:UPDATE=73,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=63,cinder:SELECT=72,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Created reservations ['9f97c2be-2f0c-4c93-b742-a787fb916ce7', '4075716d-2da2-4361-83e2-6f600342bb27', '4c32bfec-1c75-4c99-b448-0929b0bea498', '3ca0a3af-9dd3-4523-8e19-79a2e0d62374'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:50 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:06:50 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:51 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.304s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:51 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Deleted volume successfully. Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-84150026-37a4-4eef-960e-c2a957286acd tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-2fc7065a-5275-4d9e-b2c5-1a79e345574b-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "cinder-32b7f10a-5e36-459d-a609-7d76a3750e8c-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "cinder-32b7f10a-5e36-459d-a609-7d76a3750e8c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "cinder-quobyte-32b7f10a-5e36-459d-a609-7d76a3750e8c" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "cinder-quobyte-32b7f10a-5e36-459d-a609-7d76a3750e8c" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec04044a-67da-4da1-a601-08b51748849a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "cinder-8048e260-37aa-4217-a3ee-3a3f93bff208-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:51 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c Nov 04 19:06:51 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-8048e260-37aa-4217-a3ee-3a3f93bff208-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "cinder-quobyte-8048e260-37aa-4217-a3ee-3a3f93bff208" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-quobyte-8048e260-37aa-4217-a3ee-3a3f93bff208" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa7e5d0-8ef2-4afe-87d8-108799b5e7cc]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:52 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208 Nov 04 19:06:52 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:52 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c" returned: 0 in 0.473s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:52 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c Nov 04 19:06:52 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:52 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208" returned: 0 in 0.439s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:52 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32b7f10a-5e36-459d-a609-7d76a3750e8c" returned: 0 in 0.272s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:52 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208 Nov 04 19:06:52 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "cinder-quobyte-32b7f10a-5e36-459d-a609-7d76a3750e8c" released by "delete_volume" :: held 0.811s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Created reservations ['588fcf7e-5e32-47b6-9a5c-1d8d5e987752', '308bbf66-08ed-40c3-b5d5-b48bec193f59', '286a825e-4b37-4585-9608-a0c83f1a2b15', '57a41eb6-fcb9-462b-be69-3398226cfff3'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:52 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:06:52 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:52 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8048e260-37aa-4217-a3ee-3a3f93bff208" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-quobyte-8048e260-37aa-4217-a3ee-3a3f93bff208" released by "delete_volume" :: held 0.796s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "cinder-4c097858-0466-4f85-9bb5-4cbd0dc61b57-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "cinder-4c097858-0466-4f85-9bb5-4cbd0dc61b57-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "cinder-quobyte-4c097858-0466-4f85-9bb5-4cbd0dc61b57" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Created reservations ['b68f28ef-a3e4-4b71-ac58-25ce2b6cecf2', '07bdf889-3713-4203-83fe-686480f0dad8', '3cd912e4-bfdf-4b5c-a773-5e6ca787f2ee', 'a335d330-667b-4dc0-9a56-06ef0fc367f1'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "cinder-quobyte-4c097858-0466-4f85-9bb5-4cbd0dc61b57" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94de3f5-03f4-4821-8cf6-5f60aa63b03d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:52 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.302s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:52 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:52 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Deleted volume successfully. Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ce6db985-ad7e-4abf-83fb-08396848d51f tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "cinder-32b7f10a-5e36-459d-a609-7d76a3750e8c-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:53 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:06:53 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:53 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57 Nov 04 19:06:53 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "cinder-78b82a6a-b9fb-4008-b40e-68fc2723c8bb-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-78b82a6a-b9fb-4008-b40e-68fc2723c8bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "cinder-quobyte-78b82a6a-b9fb-4008-b40e-68fc2723c8bb" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-quobyte-78b82a6a-b9fb-4008-b40e-68fc2723c8bb" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e5b073-6fed-42c4-a41c-6bf24fe3fb19]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:53 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.318s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:53 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Deleted volume successfully. Nov 04 19:06:53 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57" returned: 0 in 0.456s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:53 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb Nov 04 19:06:53 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-08be9223-82ac-41e2-93de-4a85a9511ae9 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-8048e260-37aa-4217-a3ee-3a3f93bff208-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:53 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57 Nov 04 19:06:53 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:53 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4c097858-0466-4f85-9bb5-4cbd0dc61b57" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:53 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb" returned: 0 in 0.438s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "cinder-quobyte-4c097858-0466-4f85-9bb5-4cbd0dc61b57" released by "delete_volume" :: held 0.792s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:53 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb Nov 04 19:06:53 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Created reservations ['4c9408b3-f460-4416-9eef-907390549a5e', '7e41ddc0-6718-4261-b4de-979f3191121b', '1228c54c-851e-4b69-aefd-75889a9cf2b7', '47e4e532-64fc-40b3-9d52-9406f52c0d9c'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:53 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:06:53 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:54 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-78b82a6a-b9fb-4008-b40e-68fc2723c8bb" returned: 0 in 0.318s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-quobyte-78b82a6a-b9fb-4008-b40e-68fc2723c8bb" released by "delete_volume" :: held 0.810s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Created reservations ['a4c03ccb-e385-43bc-a21a-eee6bef023ce', 'ec6c3013-0b2a-439d-a46c-debe13b4c00e', '4d41721a-b278-4756-bf9f-34d1fa0fc80c', 'ca899cf2-2a1b-4b0c-89c3-f253a97f0228'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:06:54 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.304s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Deleted volume successfully. Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0fc665c0-1881-4656-a788-e312dcfb202b tempest-TestServerVolumeAttachmentScenario-730839684 None] Lock "cinder-4c097858-0466-4f85-9bb5-4cbd0dc61b57-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:06:54 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:06:54 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:06:54 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.324s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:06:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Deleted volume successfully. Nov 04 19:06:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-63691bd9-8120-4175-bbd1-88806abb47a6 tempest-CreateVolumesFromImageTest-611829995 None] Lock "cinder-78b82a6a-b9fb-4008-b40e-68fc2723c8bb-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:04 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:INSERT=8,cinder:UPDATE=35,cinder:SELECT=26,cinder:DELETE=1 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:07:04 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=20,cinder:INSERT=12,cinder:UPDATE=44,cinder:DELETE=4 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:16 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:07:16 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:16 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.316s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:07:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:07:22 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-90f55f28-e1c9-4268-8460-8e4a850f1580 req-a5599f6b-1153-47a4-908f-5ba8c6b9c761 tempest-TestMinimumBasicScenario-2109964456 None] Terminate volume connection completed successfully. Nov 04 19:07:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-90f55f28-e1c9-4268-8460-8e4a850f1580 req-a5599f6b-1153-47a4-908f-5ba8c6b9c761 tempest-TestMinimumBasicScenario-2109964456 None] Deleting attachment 7e46921d-375e-4ba0-a4f2-63f93a81ee08. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:07:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Acquiring lock "cinder-cf79e0c0-58af-4d79-93e7-81ed20084186-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Lock "cinder-cf79e0c0-58af-4d79-93e7-81ed20084186-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Acquiring lock "cinder-quobyte-cf79e0c0-58af-4d79-93e7-81ed20084186" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Lock "cinder-quobyte-cf79e0c0-58af-4d79-93e7-81ed20084186" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:23 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aab6488-3167-4907-8fdf-a7c509f8ccf4]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:23 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186 Nov 04 19:07:23 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:23 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186" returned: 0 in 0.424s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:23 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186 Nov 04 19:07:23 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:24 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cf79e0c0-58af-4d79-93e7-81ed20084186" returned: 0 in 0.269s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Lock "cinder-quobyte-cf79e0c0-58af-4d79-93e7-81ed20084186" released by "delete_volume" :: held 0.748s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Created reservations ['66705a15-b6e2-4a38-bb6d-05b033b62bde', '8081c5d6-219c-4b69-ba40-7799a2d70723', '66997b8b-2cad-433e-b8b4-082f7ff75299', '025021f7-1d81-4ed2-a9ea-abdce73a2dd3'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:24 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:07:24 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:24 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.301s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:07:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Deleted volume successfully. Nov 04 19:07:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-067d5fbc-30d6-4fc0-a279-df6f1ee28687 tempest-TestMinimumBasicScenario-2109964456 None] Lock "cinder-cf79e0c0-58af-4d79-93e7-81ed20084186-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Flow 'volume_create_manager' (c1e1f967-e9a4-48af-b66a-70c5a9393e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bb7dab-951c-4d30-9624-5a58dbe06005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bb7dab-951c-4d30-9624-5a58dbe06005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1599049235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665b2156-0912-497b-b114-1766776ba8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e26151414f14814a0af2087a552d0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:34Z,use_quota=True,user_id='a4e43161451c41eeb31e01094210a41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e530581e-01a2-4de5-8b34-550dc98196e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e530581e-01a2-4de5-8b34-550dc98196e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797e2894-7d13-4e89-ab2b-92922bf477dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.image.glance [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Creating Keystone auth plugin from conf {{(pid=87364) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797e2894-7d13-4e89-ab2b-92922bf477dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '665b2156-0912-497b-b114-1766776ba8a5', 'volume_name': 'volume-665b2156-0912-497b-b114-1766776ba8a5', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42beb765-9301-4365-b989-de5cac3c091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42beb765-9301-4365-b989-de5cac3c091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aea8d19-ffad-409a-bd8f-83de8cbe26c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:34 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Volume 665b2156-0912-497b-b114-1766776ba8a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-665b2156-0912-497b-b114-1766776ba8a5', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 04 19:07:34 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Trying to clone 665b2156-0912-497b-b114-1766776ba8a5 from image 49906b66-c86b-4e49-9cb0-47d303080f8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]). {{(pid=87364) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:07:35 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:07:35 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Image download 20.69 MB at 20.69 MB/s Nov 04 19:07:35 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f42586-f03e-4934-a0d7-2b702781a2ad]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:35 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD Nov 04 19:07:35 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:35 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:35 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Temporary image 49906b66-c86b-4e49-9cb0-47d303080f8f is fetched for user a4e43161451c41eeb31e01094210a41b. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:07:35 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c0bc3-ed72-4979-a958-509c91908a87]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:35 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD Nov 04 19:07:35 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:36 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1599049235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665b2156-0912-497b-b114-1766776ba8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e26151414f14814a0af2087a552d0b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:34Z,use_quota=True,user_id='a4e43161451c41eeb31e01094210a41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Creating volume 665b2156-0912-497b-b114-1766776ba8a5 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:36 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:36 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 1073741824 Nov 04 19:07:36 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:36 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 1073741824" returned: 0 in 0.470s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:36 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 Nov 04 19:07:36 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:36 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5" returned: 0 in 0.265s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:37 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Attempting download of 49906b66-c86b-4e49-9cb0-47d303080f8f ((None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}])) to volume 665b2156-0912-497b-b114-1766776ba8a5. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:07:37 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2edc8ed-c4db-4e2d-a51a-a71ed27d9c5d]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_7lv0wea7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:37 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_7lv0wea7 Nov 04 19:07:37 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:37 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_7lv0wea7" returned: 0 in 0.349s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_7lv0wea7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:37 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_7lv0wea7 Nov 04 19:07:37 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:37 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_7lv0wea7" returned: 1 in 0.343s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49906b66-c86b-4e49-9cb0-47d303080f8f_7lv0wea7' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:07:37 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e75821-e5e9-46fb-94ca-02985135a618]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:37 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD Nov 04 19:07:37 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:38 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:38 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] 49906b66-c86b-4e49-9cb0-47d303080f8f was qcow2, converting to qcow2 {{(pid=87364) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:07:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:38 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 Nov 04 19:07:38 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:40 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5" returned: 0 in 2.044s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49906b66-c86b-4e49-9cb0-47d303080f8f_hca_d1h9devstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:07:40 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Converted 112.00 MB image at 54.76 MB/s Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:40 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 1G Nov 04 19:07:40 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:40 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 1G" returned: 0 in 0.351s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Downloaded image 49906b66-c86b-4e49-9cb0-47d303080f8f ((None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}])) to volume 665b2156-0912-497b-b114-1766776ba8a5 successfully. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Temporary image 49906b66-c86b-4e49-9cb0-47d303080f8f for user a4e43161451c41eeb31e01094210a41b is deleted. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Marking volume 665b2156-0912-497b-b114-1766776ba8a5 as bootable. {{(pid=87364) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Copying metadata from image 49906b66-c86b-4e49-9cb0-47d303080f8f to 665b2156-0912-497b-b114-1766776ba8a5. {{(pid=87364) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Creating volume glance metadata for volume 665b2156-0912-497b-b114-1766776ba8a5 backed by image 49906b66-c86b-4e49-9cb0-47d303080f8f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87364) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aea8d19-ffad-409a-bd8f-83de8cbe26c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665b2156-0912-497b-b114-1766776ba8a5', 'volume_size': 1, 'image_id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49906b66-c86b-4e49-9cb0-47d303080f8f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4c576a35f254199852f66572a079813', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '49906b66-c86b-4e49-9cb0-47d303080f8f', 'created_at': datetime.datetime(2026, 11, 4, 17, 44, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 17, 44, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49906b66-c86b-4e49-9cb0-47d303080f8f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cf829f-bd4c-49b0-8d2f-43e31a67de17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:40 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Volume volume-665b2156-0912-497b-b114-1766776ba8a5 (665b2156-0912-497b-b114-1766776ba8a5): created successfully Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cf829f-bd4c-49b0-8d2f-43e31a67de17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:40 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Flow 'volume_create_manager' (c1e1f967-e9a4-48af-b66a-70c5a9393e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:40 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-51b5c157-c2ee-401d-90df-adb319b1c82f tempest-TestShelveInstance-1641053373 None] Created volume successfully. Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (ef9d1693-4400-4943-8a51-86b9ff73fdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dcc680-6dd3-4c94-84de-f83c206d22b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9dcc680-6dd3-4c94-84de-f83c206d22b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145764373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adc4741-b13f-425b-8b0d-e3d896a1b086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:44Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4c8caf-df65-43b1-8ada-d5ddba28cf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4c8caf-df65-43b1-8ada-d5ddba28cf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11dd6628-f02d-41ec-b85b-4da0a8bf2800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11dd6628-f02d-41ec-b85b-4da0a8bf2800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4adc4741-b13f-425b-8b0d-e3d896a1b086', 'volume_name': 'volume-4adc4741-b13f-425b-8b0d-e3d896a1b086', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e227f0b4-c2c6-4215-b942-b27b6650b855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e227f0b4-c2c6-4215-b942-b27b6650b855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dd7369-73d8-4cd7-bda8-978b129e6989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:43 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume 4adc4741-b13f-425b-8b0d-e3d896a1b086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4adc4741-b13f-425b-8b0d-e3d896a1b086', 'volume_size': 1} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145764373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adc4741-b13f-425b-8b0d-e3d896a1b086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:44Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Creating volume 4adc4741-b13f-425b-8b0d-e3d896a1b086 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:43 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:07:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:44 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 1073741824 Nov 04 19:07:44 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:44 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 1073741824" returned: 0 in 0.582s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:44 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 Nov 04 19:07:44 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-91061fbf-08b2-4db6-9856-69bc62026463 req-19871e81-3094-4f1b-9d88-1a0de9cff101 tempest-TestShelveInstance-1641053373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:44 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086" returned: 0 in 0.305s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-91061fbf-08b2-4db6-9856-69bc62026463 req-19871e81-3094-4f1b-9d88-1a0de9cff101 tempest-TestShelveInstance-1641053373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.053s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dd7369-73d8-4cd7-bda8-978b129e6989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4adc4741-b13f-425b-8b0d-e3d896a1b086', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99e8df8-ca1f-410e-a370-e46fc95a33ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-91061fbf-08b2-4db6-9856-69bc62026463 req-19871e81-3094-4f1b-9d88-1a0de9cff101 tempest-TestShelveInstance-1641053373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:44 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 (4adc4741-b13f-425b-8b0d-e3d896a1b086): created successfully Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99e8df8-ca1f-410e-a370-e46fc95a33ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (ef9d1693-4400-4943-8a51-86b9ff73fdcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7ec0d505-7e1b-41bd-a921-23b82d140a4a tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created volume successfully. Nov 04 19:07:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-91061fbf-08b2-4db6-9856-69bc62026463 req-19871e81-3094-4f1b-9d88-1a0de9cff101 tempest-TestShelveInstance-1641053373 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-665b2156-0912-497b-b114-1766776ba8a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61b852b9-6963-4576-bc3f-34dab6a1073f', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:07:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-91061fbf-08b2-4db6-9856-69bc62026463 req-19871e81-3094-4f1b-9d88-1a0de9cff101 tempest-TestShelveInstance-1641053373 None] attachment_update completed successfully. Nov 04 19:07:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] Creating offline snapshot a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 of volume 4adc4741-b13f-425b-8b0d-e3d896a1b086 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:07:46 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d9e9f2-2da5-4441-b510-7b188d994714]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:46 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 Nov 04 19:07:46 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:46 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086" returned: 0 in 0.449s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:46 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 1G Nov 04 19:07:46 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:47 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 1G" returned: 0 in 0.502s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:47 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 Nov 04 19:07:47 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:47 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9" returned: 0 in 0.400s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:47 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 is being set with open permissions: ugo+rw Nov 04 19:07:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:47 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 Nov 04 19:07:47 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:47 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9" returned: 0 in 0.369s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:48 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.info Nov 04 19:07:48 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:48 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.info" returned: 0 in 0.435s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:48 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.info is being set with open permissions: ugo+rw Nov 04 19:07:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:48 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.info Nov 04 19:07:48 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:48 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.info" returned: 0 in 0.401s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:48 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-27e6062d-ef7e-4c2e-aa9f-83c661301bdc tempest-CreateVolumesFromSnapshotTest-1823660135 None] Create snapshot completed successfully Nov 04 19:07:49 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (cbfd2cbe-faa6-4b2a-bbe8-5fe126d30e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189beb03-c053-4499-a808-22ca189c623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189beb03-c053-4499-a808-22ca189c623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-976326049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed812b52-43f0-41da-99a4-6bc62612b60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:50Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50456e0-ce1d-4e7d-860d-35c656ccf9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50456e0-ce1d-4e7d-860d-35c656ccf9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f12b9c-dd6c-431e-b811-7df0b042937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f12b9c-dd6c-431e-b811-7df0b042937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed812b52-43f0-41da-99a4-6bc62612b60a', 'volume_name': 'volume-ed812b52-43f0-41da-99a4-6bc62612b60a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cedc54-7bd2-45f0-af73-ddd20e4562b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cedc54-7bd2-45f0-af73-ddd20e4562b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2735801f-a3dd-4e8a-a93b-8dd534ea39a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:50 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume ed812b52-43f0-41da-99a4-6bc62612b60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed812b52-43f0-41da-99a4-6bc62612b60a', 'volume_size': 1} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-976326049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed812b52-43f0-41da-99a4-6bc62612b60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:50Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Creating volume ed812b52-43f0-41da-99a4-6bc62612b60a {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:50 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:50 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a 1073741824 Nov 04 19:07:50 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (ade62028-9991-4f78-8208-c007b72920ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8ea5ad-e2a7-4673-8ced-fbb42ab6cbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8ea5ad-e2a7-4673-8ced-fbb42ab6cbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534389715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c6ebaf-453c-470f-983b-5f3b9da5a48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:51Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff224aeb-d537-4653-be59-2dfacda4f13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff224aeb-d537-4653-be59-2dfacda4f13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a4efc5-4e67-4390-bb50-42e2812bdb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a4efc5-4e67-4390-bb50-42e2812bdb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c6ebaf-453c-470f-983b-5f3b9da5a48a', 'volume_name': 'volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf36314-385a-401c-a8f5-a1e5dece0a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaf36314-385a-401c-a8f5-a1e5dece0a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4459051-45de-4103-8f11-59f50beea5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:50 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume f3c6ebaf-453c-470f-983b-5f3b9da5a48a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a', 'volume_size': 1} Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:50 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a 1073741824" returned: 0 in 0.917s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:51 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a Nov 04 19:07:51 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (3cb4258b-413f-405c-84d7-29813b8f0e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd64f52-3017-4d31-8be5-72afdc41a8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd64f52-3017-4d31-8be5-72afdc41a8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1382002171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef46e9f-1229-40ae-bb8b-bc58ecff4214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:51Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cf74cf-c7cf-47e2-9e22-d9349f9f65dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cf74cf-c7cf-47e2-9e22-d9349f9f65dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5545731a-2b5e-4488-8c84-b6acc9e9fd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5545731a-2b5e-4488-8c84-b6acc9e9fd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef46e9f-1229-40ae-bb8b-bc58ecff4214', 'volume_name': 'volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7af975-0174-416a-99ff-db3c1e662e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7af975-0174-416a-99ff-db3c1e662e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624f98d9-e15d-4200-9bff-e6cc47005a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:51 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume 0ef46e9f-1229-40ae-bb8b-bc58ecff4214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214', 'volume_size': 1} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:51 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a" returned: 0 in 0.415s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.549s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534389715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c6ebaf-453c-470f-983b-5f3b9da5a48a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:51Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Creating volume f3c6ebaf-453c-470f-983b-5f3b9da5a48a {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:51 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2735801f-a3dd-4e8a-a93b-8dd534ea39a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed812b52-43f0-41da-99a4-6bc62612b60a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d839575a-9421-48c5-b773-55eb33ebee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:51 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a 1073741824 Nov 04 19:07:51 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:51 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume volume-ed812b52-43f0-41da-99a4-6bc62612b60a (ed812b52-43f0-41da-99a4-6bc62612b60a): created successfully Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d839575a-9421-48c5-b773-55eb33ebee36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (cbfd2cbe-faa6-4b2a-bbe8-5fe126d30e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:51 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-623ec3be-7608-4fb2-859d-c8945c2a8c15 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created volume successfully. Nov 04 19:07:52 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a 1073741824" returned: 0 in 0.546s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:53 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a Nov 04 19:07:53 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:54 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] <== create_volume: return (2551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.555s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.681s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1382002171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef46e9f-1229-40ae-bb8b-bc58ecff4214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:51Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Creating volume 0ef46e9f-1229-40ae-bb8b-bc58ecff4214 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:54 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:54 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214 1073741824 Nov 04 19:07:54 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:54 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214 1073741824" returned: 0 in 0.528s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4459051-45de-4103-8f11-59f50beea5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f01f54e-74f6-4739-a587-2ac860df6124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:56 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a (f3c6ebaf-453c-470f-983b-5f3b9da5a48a): created successfully Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f01f54e-74f6-4739-a587-2ac860df6124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (ade62028-9991-4f78-8208-c007b72920ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (128e210c-977f-4c03-97d3-903aa87859b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70f6e77-f0ff-4de1-b182-fed47a9b9f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:56 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214 Nov 04 19:07:56 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70f6e77-f0ff-4de1-b182-fed47a9b9f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-612099254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfef3fe8-ef32-404a-b029-6c082e7722c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:54Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970a32bb-b66a-4044-8a72-d95a75acfb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970a32bb-b66a-4044-8a72-d95a75acfb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a158242-8103-4047-ab0c-cd632faa0426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a158242-8103-4047-ab0c-cd632faa0426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfef3fe8-ef32-404a-b029-6c082e7722c0', 'volume_name': 'volume-dfef3fe8-ef32-404a-b029-6c082e7722c0', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d304ce-4efd-4c0d-8f0a-f49b414cbb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d304ce-4efd-4c0d-8f0a-f49b414cbb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4788cdda-a87d-462a-815f-eceb1a537bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:56 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume dfef3fe8-ef32-404a-b029-6c082e7722c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfef3fe8-ef32-404a-b029-6c082e7722c0', 'volume_size': 1} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:56 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214" returned: 0 in 0.257s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] <== create_volume: return (2595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.598s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.184s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-612099254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfef3fe8-ef32-404a-b029-6c082e7722c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:54Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Creating volume dfef3fe8-ef32-404a-b029-6c082e7722c0 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:56 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:07:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:56 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0 1073741824 Nov 04 19:07:56 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:57 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0 1073741824" returned: 0 in 0.417s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a61e7fb0-aad8-493d-9dfc-9551845b138f tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created volume successfully. Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624f98d9-e15d-4200-9bff-e6cc47005a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a032294-5188-4444-a2da-49dedea03ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:57 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214 (0ef46e9f-1229-40ae-bb8b-bc58ecff4214): created successfully Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a032294-5188-4444-a2da-49dedea03ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (3cb4258b-413f-405c-84d7-29813b8f0e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:57 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0 Nov 04 19:07:57 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-31b7551f-afaf-4796-8d06-581b3f363211 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created volume successfully. Nov 04 19:07:57 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0" returned: 0 in 0.379s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4788cdda-a87d-462a-815f-eceb1a537bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfef3fe8-ef32-404a-b029-6c082e7722c0', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c8d5a4-166a-44e3-bdea-0dd5ad72caa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:57 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume volume-dfef3fe8-ef32-404a-b029-6c082e7722c0 (dfef3fe8-ef32-404a-b029-6c082e7722c0): created successfully Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c8d5a4-166a-44e3-bdea-0dd5ad72caa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (128e210c-977f-4c03-97d3-903aa87859b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-92683ebe-1a4d-48d8-adb7-89271aa79fb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created volume successfully. Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (cbd4365e-f3d7-4b50-b419-2b78598be228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f474cb85-0353-4317-99b3-5228706b46c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f474cb85-0353-4317-99b3-5228706b46c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-277419931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f6011a-c83c-4f43-b508-7c7f1a6f6341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:58Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390c3e30-7cd1-4d34-b237-be5bca7b4bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390c3e30-7cd1-4d34-b237-be5bca7b4bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff280a2-a34d-4c1a-b2c6-2a5ceb82be70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff280a2-a34d-4c1a-b2c6-2a5ceb82be70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f6011a-c83c-4f43-b508-7c7f1a6f6341', 'volume_name': 'volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300672d0-ae5a-42da-b440-97ed4b056a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300672d0-ae5a-42da-b440-97ed4b056a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6b7c3a-ba18-44bb-8879-bd1e2acff25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:58 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume 37f6011a-c83c-4f43-b508-7c7f1a6f6341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341', 'volume_size': 1} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-277419931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f6011a-c83c-4f43-b508-7c7f1a6f6341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af61adeba7c44d5482fdd15756d4e85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:07:58Z,use_quota=True,user_id='698f609e19174e47b1772872f587e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Creating volume 37f6011a-c83c-4f43-b508-7c7f1a6f6341 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:07:58 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:58 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341 1073741824 Nov 04 19:07:58 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:58 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341 1073741824" returned: 0 in 0.507s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:58 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341 Nov 04 19:07:58 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:07:59 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341" returned: 0 in 0.326s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6b7c3a-ba18-44bb-8879-bd1e2acff25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988fa3cc-fff8-4f1e-a586-b0218f464749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:07:59 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Volume volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341 (37f6011a-c83c-4f43-b508-7c7f1a6f6341): created successfully Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988fa3cc-fff8-4f1e-a586-b0218f464749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Flow 'volume_create_manager' (cbd4365e-f3d7-4b50-b419-2b78598be228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:07:59 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ae75d4cd-6d52-4a8f-bb7c-0552d26ef437 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created volume successfully. Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-37f6011a-c83c-4f43-b508-7c7f1a6f6341-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-37f6011a-c83c-4f43-b508-7c7f1a6f6341-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-quobyte-37f6011a-c83c-4f43-b508-7c7f1a6f6341" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-37f6011a-c83c-4f43-b508-7c7f1a6f6341" acquired by "delete_volume" :: waited 0.029s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd391e16-2cac-46c7-9898-7ad1d02cf00a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:07:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:07:59 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341 Nov 04 19:07:59 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:00 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341" returned: 0 in 0.447s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:00 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341 Nov 04 19:08:00 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:00 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-37f6011a-c83c-4f43-b508-7c7f1a6f6341" returned: 0 in 0.272s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-37f6011a-c83c-4f43-b508-7c7f1a6f6341" released by "delete_volume" :: held 0.785s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created reservations ['91a19c44-1947-4fe6-bab3-e1929b6d1fc1', '919a381f-93a0-4083-a5af-33fc7a3fe013', 'b6a030aa-44a3-408b-acfe-d3bb7416989e', 'a5b54cad-da9d-481b-9b37-caade8981982'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:00 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:00 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-dfef3fe8-ef32-404a-b029-6c082e7722c0-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-dfef3fe8-ef32-404a-b029-6c082e7722c0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-quobyte-dfef3fe8-ef32-404a-b029-6c082e7722c0" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:00 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-dfef3fe8-ef32-404a-b029-6c082e7722c0" acquired by "delete_volume" :: waited 0.033s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.316s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:00 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Deleted volume successfully. Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a80a6d-a0a5-4794-a664-ad790457faf5]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-709287ac-6b70-46ba-a23c-327e545a1db7 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-37f6011a-c83c-4f43-b508-7c7f1a6f6341-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:00 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0 Nov 04 19:08:00 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:01 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0" returned: 0 in 0.363s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:01 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0 Nov 04 19:08:01 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:01 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-dfef3fe8-ef32-404a-b029-6c082e7722c0" returned: 0 in 0.248s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-dfef3fe8-ef32-404a-b029-6c082e7722c0" released by "delete_volume" :: held 0.675s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created reservations ['77d270b4-1de7-4d39-9030-b718e82b732f', 'd84085ce-f804-4832-8264-090dc26721e4', 'd223d3fd-5f85-4b3f-bf17-dd16c87539f1', '0acef823-4242-4f26-9fc6-521ab156a355'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:01 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:01 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:01 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-0ef46e9f-1229-40ae-bb8b-bc58ecff4214-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.287s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Deleted volume successfully. Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-0ef46e9f-1229-40ae-bb8b-bc58ecff4214-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-cb38544d-9da0-4863-93d0-3c921f3169ea tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-dfef3fe8-ef32-404a-b029-6c082e7722c0-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-quobyte-0ef46e9f-1229-40ae-bb8b-bc58ecff4214" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-0ef46e9f-1229-40ae-bb8b-bc58ecff4214" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede1901c-4379-42da-ac93-d38710110907]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:02 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214 Nov 04 19:08:02 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:02 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214" returned: 0 in 0.386s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:02 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214 Nov 04 19:08:02 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:02 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0ef46e9f-1229-40ae-bb8b-bc58ecff4214" returned: 0 in 0.301s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-0ef46e9f-1229-40ae-bb8b-bc58ecff4214" released by "delete_volume" :: held 0.734s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created reservations ['183819e5-25bb-4f21-afed-5a35435a3dc4', 'b58d747c-43d4-4af2-991f-71abb8e91ac4', '6e4eac04-0721-4917-84f4-8fdea9abd0ee', '2a840c46-c910-426d-88fd-0249d599c0c8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:03 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:03 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-f3c6ebaf-453c-470f-983b-5f3b9da5a48a-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-f3c6ebaf-453c-470f-983b-5f3b9da5a48a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-quobyte-f3c6ebaf-453c-470f-983b-5f3b9da5a48a" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-f3c6ebaf-453c-470f-983b-5f3b9da5a48a" acquired by "delete_volume" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a662266-c504-4631-8190-ddda1b7f92ac]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:03 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.299s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:03 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Deleted volume successfully. Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-14de2b3e-22aa-4245-9a41-8aa136c93a50 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-0ef46e9f-1229-40ae-bb8b-bc58ecff4214-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:03 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a Nov 04 19:08:03 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:03 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a" returned: 0 in 0.389s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:03 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a Nov 04 19:08:03 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:03 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-f3c6ebaf-453c-470f-983b-5f3b9da5a48a" returned: 0 in 0.259s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-f3c6ebaf-453c-470f-983b-5f3b9da5a48a" released by "delete_volume" :: held 0.700s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created reservations ['a9c652be-0a56-4a49-9946-0ff4c971fdd0', '4983ca5b-596c-415d-8fc7-8155e3fabf84', '19f99b73-7f8c-419c-984b-78d09dc22785', 'd45b4f91-a427-4d00-9148-68ad33a62d83'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:04 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:04 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-ed812b52-43f0-41da-99a4-6bc62612b60a-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:04 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.290s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:04 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Deleted volume successfully. Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-ed812b52-43f0-41da-99a4-6bc62612b60a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-e4e8d52d-6364-463e-a8ce-e4574c8da48e tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-f3c6ebaf-453c-470f-983b-5f3b9da5a48a-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-quobyte-ed812b52-43f0-41da-99a4-6bc62612b60a" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-ed812b52-43f0-41da-99a4-6bc62612b60a" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[837aedc2-779d-4e9e-a271-1bd446906592]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:04 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a Nov 04 19:08:04 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:04 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a" returned: 0 in 0.447s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:05 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a Nov 04 19:08:05 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:05 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ed812b52-43f0-41da-99a4-6bc62612b60a" returned: 0 in 0.307s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-ed812b52-43f0-41da-99a4-6bc62612b60a" released by "delete_volume" :: held 0.812s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created reservations ['015152ce-f048-40e7-8d14-7e77d9ecb958', '9aaaff70-c7f8-47a4-9183-4d0d9111a19e', '8048e57b-b4e7-4d06-a9e1-bedf46c4afed', '91bc7947-3326-46f8-8985-452d4b096efb'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:05 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:05 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-quobyte-4adc4741-b13f-425b-8b0d-e3d896a1b086" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-4adc4741-b13f-425b-8b0d-e3d896a1b086" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-quobyte-a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Deleting offline snapshot a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 of volume 4adc4741-b13f-425b-8b0d-e3d896a1b086 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] snapshot_file for this snap is: volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:08:05 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.341s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e52a122-37a0-4444-999d-0684b5c3fb2e]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Deleted volume successfully. Nov 04 19:08:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2f260a35-0ebe-43d3-a7a3-fb78a5104eb4 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-ed812b52-43f0-41da-99a4-6bc62612b60a-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:05 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 Nov 04 19:08:05 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:06 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9" returned: 0 in 0.424s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4adc4741-b13f-425b-8b0d-e3d896a1b086(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:08:06 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1689ef-a745-4f26-b34f-5e88be854f16]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:06 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 Nov 04 19:08:06 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:06 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086" returned: 0 in 0.432s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:06 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 Nov 04 19:08:06 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:07 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9" returned: 0 in 0.436s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:07 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9 Nov 04 19:08:07 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:07 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086.a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9" returned: 0 in 0.254s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9" released by "_delete_snapshot" :: held 1.724s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-4adc4741-b13f-425b-8b0d-e3d896a1b086" released by "delete_snapshot" :: held 1.758s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created reservations ['907f7d23-a00a-4dfc-bdcf-d2ce064a5ed0', '5c9ebb81-31f3-467c-a634-764759bad19d', '273c1562-e23e-4844-9cf4-6241804c0e64', '8606eac6-ac3b-4999-9eef-b47f495831a1'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:07 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Delete snapshot completed successfully. Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-baf2b88f-d8f0-4ebb-8668-8efbbf588d45 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-a7dd93d1-cabc-40f5-9b09-f342eaa4b1e9-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-4adc4741-b13f-425b-8b0d-e3d896a1b086-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-4adc4741-b13f-425b-8b0d-e3d896a1b086-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "cinder-quobyte-4adc4741-b13f-425b-8b0d-e3d896a1b086" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-4adc4741-b13f-425b-8b0d-e3d896a1b086" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca3db91-721b-4b6c-8ea9-fe6a5605a5f1]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:08 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 Nov 04 19:08:08 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:08 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086" returned: 0 in 0.391s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:08 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086 Nov 04 19:08:08 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:08 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4adc4741-b13f-425b-8b0d-e3d896a1b086" returned: 0 in 0.259s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-quobyte-4adc4741-b13f-425b-8b0d-e3d896a1b086" released by "delete_volume" :: held 0.715s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Created reservations ['ccf8d509-4ecf-499d-85f3-15a1d8b3125d', 'b35ce6a3-f3f0-433c-a1a0-ed0590d32f77', '94fa8d83-a4d1-40dd-b535-a01978f12397', '38f1bbe4-cf3b-4629-8a56-0d14fbc2f886'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:08 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:08 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:08 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.250s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:08 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Deleted volume successfully. Nov 04 19:08:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8b07d8a5-78f6-4e7a-9a2f-80015988b445 tempest-CreateVolumesFromSnapshotTest-1823660135 None] Lock "cinder-4adc4741-b13f-425b-8b0d-e3d896a1b086-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Flow 'volume_create_manager' (58136f36-55f9-4303-b9fd-d4798a3a12b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcbdbc4-3630-493a-95de-e187b5b6e38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcbdbc4-3630-493a-95de-e187b5b6e38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000805774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c659995-ea40-41fa-8b3d-d84101329680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4b07fc077a418eb32d4334e46f77b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:12Z,use_quota=True,user_id='1554fb018a4d4d9190576c722e9cb29e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb6ebe5-b104-4db4-940f-83cfb40f446b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb6ebe5-b104-4db4-940f-83cfb40f446b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1334cdb2-1b27-482f-a525-8d3d39bdfe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1334cdb2-1b27-482f-a525-8d3d39bdfe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c659995-ea40-41fa-8b3d-d84101329680', 'volume_name': 'volume-8c659995-ea40-41fa-8b3d-d84101329680', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bb24ef-9867-4a6d-a67d-d9516f9ce8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bb24ef-9867-4a6d-a67d-d9516f9ce8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1e62c3-993a-41af-a4e8-c51218461a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:12 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Volume 8c659995-ea40-41fa-8b3d-d84101329680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c659995-ea40-41fa-8b3d-d84101329680', 'volume_size': 1} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000805774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c659995-ea40-41fa-8b3d-d84101329680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4b07fc077a418eb32d4334e46f77b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:12Z,use_quota=True,user_id='1554fb018a4d4d9190576c722e9cb29e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Creating volume 8c659995-ea40-41fa-8b3d-d84101329680 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:12 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:12 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680 1073741824 Nov 04 19:08:12 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:12 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680 1073741824" returned: 0 in 0.447s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:13 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680 Nov 04 19:08:13 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:13 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680" returned: 0 in 0.267s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1e62c3-993a-41af-a4e8-c51218461a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c659995-ea40-41fa-8b3d-d84101329680', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4baa53-6695-4a51-90d1-d5f80a6f46c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:13 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Volume volume-8c659995-ea40-41fa-8b3d-d84101329680 (8c659995-ea40-41fa-8b3d-d84101329680): created successfully Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4baa53-6695-4a51-90d1-d5f80a6f46c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Flow 'volume_create_manager' (58136f36-55f9-4303-b9fd-d4798a3a12b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:13 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2ff47bfe-d8f1-47d0-b1d4-555e7e4e9862 tempest-ProjectReaderTests-688543635 None] Created volume successfully. Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Acquiring lock "cinder-8c659995-ea40-41fa-8b3d-d84101329680-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Lock "cinder-8c659995-ea40-41fa-8b3d-d84101329680-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Acquiring lock "cinder-quobyte-8c659995-ea40-41fa-8b3d-d84101329680" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Lock "cinder-quobyte-8c659995-ea40-41fa-8b3d-d84101329680" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa847c9-c0bb-45d8-b955-558e8a0ac9e2]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:13 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680 Nov 04 19:08:13 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:14 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680" returned: 0 in 0.384s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:14 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680 Nov 04 19:08:14 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:14 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8c659995-ea40-41fa-8b3d-d84101329680" returned: 0 in 0.252s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Lock "cinder-quobyte-8c659995-ea40-41fa-8b3d-d84101329680" released by "delete_volume" :: held 0.687s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=73,cinder:UPDATE=96,cinder:INSERT=29,cinder:DELETE=7 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Created reservations ['104a7574-6c8b-4194-b646-bdc385c3715d', 'a8e560d1-12c5-4820-b8ed-8fb4b27f0627', '8b75eaa8-52e4-4978-8df1-8d5d77ddeb91', '0bd9bdf7-4c26-4cde-9c1e-3e47a76c4fa2'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:14 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:14 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:14 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.283s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:14 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Deleted volume successfully. Nov 04 19:08:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4fdcabb3-a0be-46af-b0b5-cef1c85f9619 tempest-ProjectReaderTests-688543635 None] Lock "cinder-8c659995-ea40-41fa-8b3d-d84101329680-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=87,cinder:INSERT=27,cinder:UPDATE=93,cinder:DELETE=9 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Flow 'volume_create_manager' (2c15a0ee-ef06-4b89-814d-2d80476a2228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401c0ca5-f7f9-414c-8f6b-9b59e7e29130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401c0ca5-f7f9-414c-8f6b-9b59e7e29130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2091680219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef8b78c-70d5-4b66-bae7-b51f5a3244ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4b07fc077a418eb32d4334e46f77b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:15Z,use_quota=True,user_id='1554fb018a4d4d9190576c722e9cb29e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4324b2-7158-45d8-8435-48f813d206f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4324b2-7158-45d8-8435-48f813d206f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e9e803-46d2-4df6-814f-499ec7bca36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e9e803-46d2-4df6-814f-499ec7bca36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef8b78c-70d5-4b66-bae7-b51f5a3244ba', 'volume_name': 'volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730fb485-882c-41e5-9c90-3b486ca878ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730fb485-882c-41e5-9c90-3b486ca878ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e026d40a-5d47-4123-a5e7-cc4c03a56dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:15 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Volume 3ef8b78c-70d5-4b66-bae7-b51f5a3244ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba', 'volume_size': 1} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2091680219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef8b78c-70d5-4b66-bae7-b51f5a3244ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4b07fc077a418eb32d4334e46f77b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:15Z,use_quota=True,user_id='1554fb018a4d4d9190576c722e9cb29e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Creating volume 3ef8b78c-70d5-4b66-bae7-b51f5a3244ba {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:15 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:15 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba 1073741824 Nov 04 19:08:15 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:15 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba 1073741824" returned: 0 in 0.485s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:15 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba Nov 04 19:08:15 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:16 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:16 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:16 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba" returned: 0 in 0.265s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e026d40a-5d47-4123-a5e7-cc4c03a56dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d02517-c3da-4a66-866e-51fd4cdfa9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:16 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Volume volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba (3ef8b78c-70d5-4b66-bae7-b51f5a3244ba): created successfully Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d02517-c3da-4a66-866e-51fd4cdfa9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Flow 'volume_create_manager' (2c15a0ee-ef06-4b89-814d-2d80476a2228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:16 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6c35cf44-75dc-4c21-b3b6-15ca13736cd0 tempest-ProjectReaderTests-688543635 None] Created volume successfully. Nov 04 19:08:16 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.259s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:08:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:08:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Acquiring lock "cinder-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Lock "cinder-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Acquiring lock "cinder-quobyte-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Lock "cinder-quobyte-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:17 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7709422b-6b75-4001-827c-1325c89a9ba9]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:17 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba Nov 04 19:08:17 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:17 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba" returned: 0 in 0.370s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:17 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba Nov 04 19:08:17 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:18 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba" returned: 0 in 0.242s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Lock "cinder-quobyte-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba" released by "delete_volume" :: held 0.651s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Created reservations ['1ff7bf55-913c-4847-aa13-7744fe4006f3', 'b984a190-9435-41f9-a797-e6a5612008d8', '8e2bd174-1043-48b9-87c0-970650f6969e', 'c6ec12c0-5fc8-427e-b2b5-cfcbe2b4597e'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:18 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:18 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:18 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.260s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:18 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Deleted volume successfully. Nov 04 19:08:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ba4f3952-92dc-4e98-98ff-6359657e145c tempest-ProjectReaderTests-688543635 None] Lock "cinder-3ef8b78c-70d5-4b66-bae7-b51f5a3244ba-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:22 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-bcef5a87-00ff-402c-8e8c-6952f4ae9d36 req-0d1e3dfa-5dc4-400d-925b-a8168cf5bc14 tempest-TestShelveInstance-1641053373 None] Terminate volume connection completed successfully. Nov 04 19:08:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-bcef5a87-00ff-402c-8e8c-6952f4ae9d36 req-0d1e3dfa-5dc4-400d-925b-a8168cf5bc14 tempest-TestShelveInstance-1641053373 None] Deleting attachment 61b852b9-6963-4576-bc3f-34dab6a1073f. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Flow 'volume_create_manager' (1a0a36ad-3a51-448d-b5dd-2deaa7969882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8717ba-af84-48c7-9dff-95df615d8a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c8717ba-af84-48c7-9dff-95df615d8a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-684253723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82344725-516b-4589-8ba6-959324c5f0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d096e85103434f7c9ba6fb42ef44eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:23Z,use_quota=True,user_id='867eba4b86e54961adf29c337c241110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb1df76-4e9a-4dde-91ea-32c2bdc84777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb1df76-4e9a-4dde-91ea-32c2bdc84777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e32062-9156-45c7-b733-b8122c5999c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e32062-9156-45c7-b733-b8122c5999c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82344725-516b-4589-8ba6-959324c5f0e1', 'volume_name': 'volume-82344725-516b-4589-8ba6-959324c5f0e1', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3dfebf5-32bd-4cf8-9bf3-ff79fa63b3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3dfebf5-32bd-4cf8-9bf3-ff79fa63b3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a2fff0-eeba-4634-b592-d2e41e323c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:23 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Volume 82344725-516b-4589-8ba6-959324c5f0e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82344725-516b-4589-8ba6-959324c5f0e1', 'volume_size': 1} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-684253723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82344725-516b-4589-8ba6-959324c5f0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d096e85103434f7c9ba6fb42ef44eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:23Z,use_quota=True,user_id='867eba4b86e54961adf29c337c241110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Creating volume 82344725-516b-4589-8ba6-959324c5f0e1 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:23 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:23 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1 1073741824 Nov 04 19:08:23 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:23 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1 1073741824" returned: 0 in 0.509s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:23 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1 Nov 04 19:08:23 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:24 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1" returned: 0 in 0.286s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a2fff0-eeba-4634-b592-d2e41e323c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82344725-516b-4589-8ba6-959324c5f0e1', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a1afcb-9c01-4e05-a242-03e312094f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:24 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Volume volume-82344725-516b-4589-8ba6-959324c5f0e1 (82344725-516b-4589-8ba6-959324c5f0e1): created successfully Nov 04 19:08:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a1afcb-9c01-4e05-a242-03e312094f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Flow 'volume_create_manager' (1a0a36ad-3a51-448d-b5dd-2deaa7969882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-79879b3f-380f-41f8-8626-9021d004a6c9 tempest-ProjectReaderTests-2146084854 None] Created volume successfully. Nov 04 19:08:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-7944887b-b364-4179-9e15-069d3287bc92 req-37c17c8b-d79e-4ec3-accb-296938fc293d tempest-TestShelveInstance-1641053373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-7944887b-b364-4179-9e15-069d3287bc92 req-37c17c8b-d79e-4ec3-accb-296938fc293d tempest-TestShelveInstance-1641053373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-7944887b-b364-4179-9e15-069d3287bc92 req-37c17c8b-d79e-4ec3-accb-296938fc293d tempest-TestShelveInstance-1641053373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-7944887b-b364-4179-9e15-069d3287bc92 req-37c17c8b-d79e-4ec3-accb-296938fc293d tempest-TestShelveInstance-1641053373 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6', 'name': 'volume-665b2156-0912-497b-b114-1766776ba8a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '243eba7e-a8d3-4e56-9c9e-10857f225e8f', 'enforce_multipath': True} {{(pid=87364) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 04 19:08:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-7944887b-b364-4179-9e15-069d3287bc92 req-37c17c8b-d79e-4ec3-accb-296938fc293d tempest-TestShelveInstance-1641053373 None] attachment_update completed successfully. Nov 04 19:08:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Acquiring lock "cinder-82344725-516b-4589-8ba6-959324c5f0e1-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-82344725-516b-4589-8ba6-959324c5f0e1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Acquiring lock "cinder-quobyte-82344725-516b-4589-8ba6-959324c5f0e1" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-quobyte-82344725-516b-4589-8ba6-959324c5f0e1" acquired by "delete_volume" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:25 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b71b88-b563-4dc0-a464-c47e4ccc3341]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:25 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1 Nov 04 19:08:25 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:25 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1" returned: 0 in 0.416s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:25 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1 Nov 04 19:08:25 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:26 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-82344725-516b-4589-8ba6-959324c5f0e1" returned: 0 in 0.279s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-quobyte-82344725-516b-4589-8ba6-959324c5f0e1" released by "delete_volume" :: held 0.753s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Created reservations ['27a38641-6bc8-4701-88fe-2ad880df2320', 'ea947e28-e1f6-446c-befe-1e66c632b9ff', 'a45db8c8-1a9f-4bce-81ee-8db16b1812af', '6efde30f-8d23-4e5b-b9d0-be58831f1ac9'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:26 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:26 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:26 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.321s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:26 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Deleted volume successfully. Nov 04 19:08:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c79ab525-b617-4e58-bf52-aa9489934833 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-82344725-516b-4589-8ba6-959324c5f0e1-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Flow 'volume_create_manager' (b8e276dc-5fc6-4267-9364-166534030629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38018121-ea76-4040-ac55-5023cd8a01a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38018121-ea76-4040-ac55-5023cd8a01a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102382594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8dd3e0-2621-4da1-ad50-09faaa1c081c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d096e85103434f7c9ba6fb42ef44eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:27Z,use_quota=True,user_id='867eba4b86e54961adf29c337c241110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a053234-7df8-49c3-8318-9ccd8c913e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a053234-7df8-49c3-8318-9ccd8c913e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d16426-5db2-4f4c-90c9-3ccbdd049226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d16426-5db2-4f4c-90c9-3ccbdd049226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8dd3e0-2621-4da1-ad50-09faaa1c081c', 'volume_name': 'volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e06c32-5248-4153-b706-2d30e7455d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e06c32-5248-4153-b706-2d30e7455d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8c3097-ee00-4847-b671-c7a77bb3a995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:27 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Volume df8dd3e0-2621-4da1-ad50-09faaa1c081c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c', 'volume_size': 1} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102382594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8dd3e0-2621-4da1-ad50-09faaa1c081c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d096e85103434f7c9ba6fb42ef44eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:27Z,use_quota=True,user_id='867eba4b86e54961adf29c337c241110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Creating volume df8dd3e0-2621-4da1-ad50-09faaa1c081c {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:27 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:27 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c 1073741824 Nov 04 19:08:27 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:27 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c 1073741824" returned: 0 in 0.709s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:28 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c Nov 04 19:08:28 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:28 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c" returned: 0 in 0.497s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8c3097-ee00-4847-b671-c7a77bb3a995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4bbbde-3f84-4913-a7e6-f666440f1ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:28 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Volume volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c (df8dd3e0-2621-4da1-ad50-09faaa1c081c): created successfully Nov 04 19:08:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4bbbde-3f84-4913-a7e6-f666440f1ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Flow 'volume_create_manager' (b8e276dc-5fc6-4267-9364-166534030629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:28 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-478bf294-dad1-4178-bd7e-24342c3039cd tempest-ProjectReaderTests-2146084854 None] Created volume successfully. Nov 04 19:08:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Acquiring lock "cinder-df8dd3e0-2621-4da1-ad50-09faaa1c081c-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-df8dd3e0-2621-4da1-ad50-09faaa1c081c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Acquiring lock "cinder-quobyte-df8dd3e0-2621-4da1-ad50-09faaa1c081c" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-quobyte-df8dd3e0-2621-4da1-ad50-09faaa1c081c" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:29 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd45e54-1487-4310-a640-c68935cde642]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:29 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c Nov 04 19:08:29 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:29 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c" returned: 0 in 0.398s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:29 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c Nov 04 19:08:29 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:30 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-df8dd3e0-2621-4da1-ad50-09faaa1c081c" returned: 0 in 0.263s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-quobyte-df8dd3e0-2621-4da1-ad50-09faaa1c081c" released by "delete_volume" :: held 0.707s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Created reservations ['6926edaa-96ed-48a2-9c74-c2ff0323b47b', '426ea9fe-6d25-46b0-8ab4-6b04a2a94a05', '08bc1566-4c79-4848-9de9-839817144a99', '64f24b36-0ae3-4aed-a76f-bf8890729d09'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:30 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:30 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:30 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.297s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:30 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Deleted volume successfully. Nov 04 19:08:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-70e27c6e-0d00-4144-b5a0-5fc7d50745f6 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-df8dd3e0-2621-4da1-ad50-09faaa1c081c-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Flow 'volume_create_manager' (43e5cc59-54bd-46ec-a6df-6d9cf49b6639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3f61c6-882f-4215-b0e2-729cb3448dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3f61c6-882f-4215-b0e2-729cb3448dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890796844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d096e85103434f7c9ba6fb42ef44eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:31Z,use_quota=True,user_id='867eba4b86e54961adf29c337c241110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c073a6-d24e-4457-b1b6-34b433bf5ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c073a6-d24e-4457-b1b6-34b433bf5ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175f3a8c-9200-4a72-9b04-069cc8e2671b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175f3a8c-9200-4a72-9b04-069cc8e2671b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74', 'volume_name': 'volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888c9cd4-6cf3-44bd-833d-3648c37a03f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888c9cd4-6cf3-44bd-833d-3648c37a03f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d35494-6fad-4ae4-afd0-1c72969af78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:31 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Volume 880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74', 'volume_size': 1} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890796844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d096e85103434f7c9ba6fb42ef44eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:31Z,use_quota=True,user_id='867eba4b86e54961adf29c337c241110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Creating volume 880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:31 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:31 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74 1073741824 Nov 04 19:08:31 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:31 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74 1073741824" returned: 0 in 0.489s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:31 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74 Nov 04 19:08:31 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:32 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74" returned: 0 in 0.286s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d35494-6fad-4ae4-afd0-1c72969af78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ef7aa6-6bee-450e-ba07-de83aac7935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:32 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Volume volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74 (880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74): created successfully Nov 04 19:08:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ef7aa6-6bee-450e-ba07-de83aac7935f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Flow 'volume_create_manager' (43e5cc59-54bd-46ec-a6df-6d9cf49b6639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:32 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c11e1b18-dc2c-40ff-a4dd-fd0371cd8c1c tempest-ProjectReaderTests-2146084854 None] Created volume successfully. Nov 04 19:08:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Acquiring lock "cinder-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Acquiring lock "cinder-quobyte-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-quobyte-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:33 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1870214a-fce8-4c06-aee2-146b8200c8eb]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:33 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74 Nov 04 19:08:33 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:33 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74" returned: 0 in 0.437s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:33 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74 Nov 04 19:08:33 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:34 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74" returned: 0 in 0.269s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-quobyte-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74" released by "delete_volume" :: held 0.754s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Created reservations ['e1ae658d-458a-45c5-b59e-5df5821462a8', 'f807fa1e-0629-4069-8f89-ef010f566aed', '19f86d86-6dbe-4df5-b4e5-46204702aa88', 'c2b3af23-3b57-44a5-9295-7448e5106a13'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:34 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:34 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:34 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:34 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Deleted volume successfully. Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5f9e2cef-208c-404a-ad46-8602f4ef1b00 tempest-ProjectReaderTests-2146084854 None] Lock "cinder-880e4bf9-d5ec-4a9e-b7c2-dd0b7b64ca74-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Flow 'volume_create_manager' (5804cb45-8582-45e7-85bc-c4a3ac297719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7905a6f8-4b0e-4a96-908b-72b6d223e6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7905a6f8-4b0e-4a96-908b-72b6d223e6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-911864813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ecdd2f-f3fc-4c41-a195-e2f5a42147e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d096e85103434f7c9ba6fb42ef44eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:35Z,use_quota=True,user_id='867eba4b86e54961adf29c337c241110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93da04a-415e-4652-ac64-1227fe8ba808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93da04a-415e-4652-ac64-1227fe8ba808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982161ee-ffdb-45a1-a179-b7b65ed11db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982161ee-ffdb-45a1-a179-b7b65ed11db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ecdd2f-f3fc-4c41-a195-e2f5a42147e9', 'volume_name': 'volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e15587d-2d56-44b5-b330-363d32bd8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e15587d-2d56-44b5-b330-363d32bd8278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a512e80-d462-490f-885b-01d2d8150b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:35 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Volume 08ecdd2f-f3fc-4c41-a195-e2f5a42147e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9', 'volume_size': 1} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-911864813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ecdd2f-f3fc-4c41-a195-e2f5a42147e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d096e85103434f7c9ba6fb42ef44eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:08:35Z,use_quota=True,user_id='867eba4b86e54961adf29c337c241110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Creating volume 08ecdd2f-f3fc-4c41-a195-e2f5a42147e9 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:08:35 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:35 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9 1073741824 Nov 04 19:08:35 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:35 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9 1073741824" returned: 0 in 0.428s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:35 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9 Nov 04 19:08:35 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:35 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9" returned: 0 in 0.244s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a512e80-d462-490f-885b-01d2d8150b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175705a0-a1a3-4c26-91c9-49feeb2b08d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:08:35 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Volume volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9 (08ecdd2f-f3fc-4c41-a195-e2f5a42147e9): created successfully Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175705a0-a1a3-4c26-91c9-49feeb2b08d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:08:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Flow 'volume_create_manager' (5804cb45-8582-45e7-85bc-c4a3ac297719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:08:35 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-05e930e8-62d7-4df2-94ed-18a594243a3d tempest-ProjectReaderTests-2146084854 None] Created volume successfully. Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Acquiring lock "cinder-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Lock "cinder-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Acquiring lock "cinder-quobyte-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Lock "cinder-quobyte-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a76dd0-8f8c-4010-8f61-7fade140d198]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:36 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9 Nov 04 19:08:36 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:36 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9" returned: 0 in 0.362s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:36 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9 Nov 04 19:08:36 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:36 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9" returned: 0 in 0.263s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Lock "cinder-quobyte-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9" released by "delete_volume" :: held 0.675s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Created reservations ['72407e56-113b-4a04-a349-def2c09e382c', '66a30db0-988a-4048-8f9f-36ada8e1e2bc', '14da88dc-e154-44d7-9feb-30b97ca9b7ed', '42b2ac83-5813-484a-95a7-bcafcffdbfb6'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:08:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:08:36 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:08:36 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:08:37 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Nov 04 19:08:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.243s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:08:37 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:08:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Deleted volume successfully. Nov 04 19:08:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d8cc2d43-146c-460e-9d09-c1ffb26dcaac tempest-ProjectReaderTests-2146084854 None] Lock "cinder-08ecdd2f-f3fc-4c41-a195-e2f5a42147e9-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:08:46 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=57,cinder:INSERT=13,cinder:SELECT=42,cinder:DELETE=4 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:08:47 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=44,cinder:INSERT=14,cinder:UPDATE=64,cinder:DELETE=7 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Flow 'volume_create_manager' (da78c466-73e8-4967-95ae-9102fb853c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cb4d14-338f-4f55-bf20-3bc636120b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cb4d14-338f-4f55-bf20-3bc636120b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-978834083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6aebb1c-a173-4d53-9a23-4aeff51d14df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc4c0fa7624451ebee3cfae0b1bb907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:00Z,use_quota=True,user_id='4f5b28da278f4876aa7328dfbba509d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8ca260-a50f-4d01-81a0-84d386d33294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8ca260-a50f-4d01-81a0-84d386d33294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463f1e9d-7d9a-4ad2-9698-af6763fc18a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463f1e9d-7d9a-4ad2-9698-af6763fc18a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6aebb1c-a173-4d53-9a23-4aeff51d14df', 'volume_name': 'volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22673a0-c1f4-4052-90d8-9ffda3388c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22673a0-c1f4-4052-90d8-9ffda3388c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6bbd35-c8ef-4f72-811b-31817ebfb1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:00 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Volume c6aebb1c-a173-4d53-9a23-4aeff51d14df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df', 'volume_size': 1} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-978834083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6aebb1c-a173-4d53-9a23-4aeff51d14df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc4c0fa7624451ebee3cfae0b1bb907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:00Z,use_quota=True,user_id='4f5b28da278f4876aa7328dfbba509d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Creating volume c6aebb1c-a173-4d53-9a23-4aeff51d14df {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:09:00 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:00 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df 1073741824 Nov 04 19:09:00 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:00 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df 1073741824" returned: 0 in 0.427s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:00 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df Nov 04 19:09:00 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:01 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df" returned: 0 in 0.246s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6bbd35-c8ef-4f72-811b-31817ebfb1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9825f0dd-df3e-4c18-9ac2-bcdf7d6df3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:01 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Volume volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df (c6aebb1c-a173-4d53-9a23-4aeff51d14df): created successfully Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9825f0dd-df3e-4c18-9ac2-bcdf7d6df3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Flow 'volume_create_manager' (da78c466-73e8-4967-95ae-9102fb853c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ec082cbc-9a2a-46a9-83f3-260e94e28763 tempest-SnapshotDependencyTests-729545247 None] Created volume successfully. Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] Creating offline snapshot b9985f35-cdf5-438e-89db-4ec30b904adf of volume c6aebb1c-a173-4d53-9a23-4aeff51d14df {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db8a326-4180-41f4-aa4a-387aa8d0a0d3]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:01 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df Nov 04 19:09:01 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:01 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df" returned: 0 in 0.370s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:01 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf 1G Nov 04 19:09:01 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:02 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf 1G" returned: 0 in 0.382s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:02 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf Nov 04 19:09:02 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:02 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf" returned: 0 in 0.285s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:02 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf is being set with open permissions: ugo+rw Nov 04 19:09:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:02 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf Nov 04 19:09:02 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:02 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf" returned: 0 in 0.237s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:02 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.info Nov 04 19:09:02 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:03 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.info" returned: 0 in 0.247s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:03 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.info is being set with open permissions: ugo+rw Nov 04 19:09:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:03 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.info Nov 04 19:09:03 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:03 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.info" returned: 0 in 0.238s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:03 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-985bbdd3-58a1-4fb1-95ae-5782429c7a30 tempest-SnapshotDependencyTests-729545247 None] Create snapshot completed successfully Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Flow 'volume_create_manager' (8ccd5a59-c180-47e6-b6ad-6e655da2809a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ca68e7-c28c-4e51-8145-91a41db1d8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ca68e7-c28c-4e51-8145-91a41db1d8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc4c0fa7624451ebee3cfae0b1bb907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b9985f35-cdf5-438e-89db-4ec30b904adf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:04Z,use_quota=True,user_id='4f5b28da278f4876aa7328dfbba509d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637159cc-d937-4c11-8fc3-2039982d5357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637159cc-d937-4c11-8fc3-2039982d5357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da1f52c-f947-46af-ab64-8d0fe988890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da1f52c-f947-46af-ab64-8d0fe988890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6', 'volume_name': 'volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6', 'volume_size': 1, 'snapshot_id': 'b9985f35-cdf5-438e-89db-4ec30b904adf'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a743b633-cc1c-4770-8559-0bc03f81ed5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a743b633-cc1c-4770-8559-0bc03f81ed5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1380e294-74df-4627-9176-479f04eea07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:04 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Volume 3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6', 'volume_size': 1, 'snapshot_id': 'b9985f35-cdf5-438e-89db-4ec30b904adf'} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "cinder-quobyte-b9985f35-cdf5-438e-89db-4ec30b904adf-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" by "_create_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-b9985f35-cdf5-438e-89db-4ec30b904adf-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Creating volume 3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 from snapshot b9985f35-cdf5-438e-89db-4ec30b904adf {{(pid=87364) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "cinder-quobyte-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] snapshot: b9985f35-cdf5-438e-89db-4ec30b904adf, volume: 3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8872138-756c-4df7-9557-ecccda7cb15b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:04 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf Nov 04 19:09:04 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:04 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf" returned: 0 in 0.368s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d73ad3d-1cff-4fad-93eb-5b04dcd28cf7]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:04 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df Nov 04 19:09:04 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:05 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df" returned: 0 in 0.355s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:09:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:09:05 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:09:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:05 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 Nov 04 19:09:05 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:11 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-1daf7ea2-990e-4f67-a27c-bfdd42952533 tempest-TestShelveInstance-1641053373 None] Terminate volume connection completed successfully. Nov 04 19:09:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-1daf7ea2-990e-4f67-a27c-bfdd42952533 tempest-TestShelveInstance-1641053373 None] Deleting attachment 243eba7e-a8d3-4e56-9c9e-10857f225e8f. {{(pid=87364) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 04 19:09:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Acquiring lock "cinder-665b2156-0912-497b-b114-1766776ba8a5-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Lock "cinder-665b2156-0912-497b-b114-1766776ba8a5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Acquiring lock "cinder-quobyte-665b2156-0912-497b-b114-1766776ba8a5" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Lock "cinder-quobyte-665b2156-0912-497b-b114-1766776ba8a5" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:11 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e556760b-06ca-454f-ab1f-06dcbb04f1dc]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:11 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 Nov 04 19:09:11 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:12 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5" returned: 0 in 0.869s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:12 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5 Nov 04 19:09:12 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:12 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" returned: 0 in 7.382s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df, size 1024.00 MB, duration 7.38 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:09:12 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Converted 1024.00 MB image at 138.69 MB/s Nov 04 19:09:12 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 is being set with open permissions: ugo+rw Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:12 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 Nov 04 19:09:12 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:12 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-665b2156-0912-497b-b114-1766776ba8a5" returned: 0 in 0.355s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Lock "cinder-quobyte-665b2156-0912-497b-b114-1766776ba8a5" released by "delete_volume" :: held 1.310s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG cinder.quota [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Created reservations ['fac460fb-dba6-41de-8c37-a624c9423eee', '5ab6e155-57e5-4329-ac2f-85d9061ef9f6', '37a22617-1021-48dd-b96c-44dd1aa3c5dc', 'aa9691b8-ce2e-4111-bcb5-6b16dbd38f68'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:12 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" returned: 0 in 0.260s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" released by "_copy_volume_from_snapshot" :: held 8.445s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:12 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:09:12 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-b9985f35-cdf5-438e-89db-4ec30b904adf-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" released by "_create_volume_from_snapshot" :: held 8.536s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.552s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1380e294-74df-4627-9176-479f04eea07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6', 'volume_size': 1, 'snapshot_id': 'b9985f35-cdf5-438e-89db-4ec30b904adf'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7485cb-2328-4cff-8ad2-2e8ea56c6ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:12 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Volume volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 (3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6): created successfully Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7485cb-2328-4cff-8ad2-2e8ea56c6ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Flow 'volume_create_manager' (8ccd5a59-c180-47e6-b6ad-6e655da2809a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:12 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0c85fc64-5db6-404c-acc6-332573c71e1c tempest-SnapshotDependencyTests-729545247 None] Created volume successfully. Nov 04 19:09:13 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.242s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG cinder.manager [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:13 devstack cinder-volume[87364]: INFO cinder.volume.manager [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Deleted volume successfully. Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [req-8ab3bc4f-610a-4243-8c4e-7f7cdf1c818c req-bef70e7e-0177-40f1-8854-b4d3419c6944 tempest-TestShelveInstance-1641053373 None] Lock "cinder-665b2156-0912-497b-b114-1766776ba8a5-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "cinder-b9985f35-cdf5-438e-89db-4ec30b904adf-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-b9985f35-cdf5-438e-89db-4ec30b904adf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "cinder-quobyte-c6aebb1c-a173-4d53-9a23-4aeff51d14df" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-c6aebb1c-a173-4d53-9a23-4aeff51d14df" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "cinder-quobyte-b9985f35-cdf5-438e-89db-4ec30b904adf" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-b9985f35-cdf5-438e-89db-4ec30b904adf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Deleting offline snapshot b9985f35-cdf5-438e-89db-4ec30b904adf of volume c6aebb1c-a173-4d53-9a23-4aeff51d14df {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] snapshot_file for this snap is: volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd3b7dc-0583-4a66-891c-7dc8ff093355]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:13 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf Nov 04 19:09:13 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:13 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf" returned: 0 in 0.416s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed391b-a702-4f3d-9cbd-b1be75a9e07a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:13 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df Nov 04 19:09:13 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:14 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df" returned: 0 in 0.570s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:14 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf Nov 04 19:09:14 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:14 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf" returned: 0 in 0.367s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:14 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf Nov 04 19:09:14 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:15 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df.b9985f35-cdf5-438e-89db-4ec30b904adf" returned: 0 in 0.267s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-b9985f35-cdf5-438e-89db-4ec30b904adf" released by "_delete_snapshot" :: held 1.755s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-c6aebb1c-a173-4d53-9a23-4aeff51d14df" released by "delete_snapshot" :: held 1.782s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Created reservations ['140fc328-1f8f-4179-96e4-d9a24e5f3637', 'a3acb7a2-434a-4c07-8032-44fd6a7afa59', '4162354a-5007-46f8-930a-e6d8ec01250c', '93134bbc-1a02-4d18-9b66-6acddd010fe8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:15 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Delete snapshot completed successfully. Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-4cfeb2cb-6539-41b7-8424-d2ead036f28b tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-b9985f35-cdf5-438e-89db-4ec30b904adf-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "cinder-c6aebb1c-a173-4d53-9a23-4aeff51d14df-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-c6aebb1c-a173-4d53-9a23-4aeff51d14df-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "cinder-quobyte-c6aebb1c-a173-4d53-9a23-4aeff51d14df" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-c6aebb1c-a173-4d53-9a23-4aeff51d14df" acquired by "delete_volume" :: waited 0.013s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5bf5f4-9885-45db-85f4-fee382cbb550]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:15 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df Nov 04 19:09:15 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:15 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df" returned: 0 in 0.389s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:15 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df Nov 04 19:09:15 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:16 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:09:16 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:16 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c6aebb1c-a173-4d53-9a23-4aeff51d14df" returned: 0 in 0.289s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-c6aebb1c-a173-4d53-9a23-4aeff51d14df" released by "delete_volume" :: held 0.749s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Created reservations ['092a15db-6b38-4a73-b7ad-d1f93e45b927', '6b7d265f-2b58-4645-8940-de9ecd7df8ff', '8aaa25f3-8c8d-47e6-a300-5755fc068cec', 'edf367bd-2932-4235-a218-38bbade26c0b'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:16 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:09:16 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:16 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.254s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "cinder-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:16 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.280s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:16 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Deleted volume successfully. Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "cinder-quobyte-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-744a63a2-c4b3-4e02-868f-e364f43c1260 tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-c6aebb1c-a173-4d53-9a23-4aeff51d14df-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce40c3d6-a742-41ba-af38-f9ab6d58fc73]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:16 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 Nov 04 19:09:16 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:17 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" returned: 0 in 0.408s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:17 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6 Nov 04 19:09:17 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:17 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" returned: 0 in 0.266s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-quobyte-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6" released by "delete_volume" :: held 0.729s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Created reservations ['c027a27b-a8ab-454c-b459-427745a778bd', '78acbc67-6dfd-41be-94a0-747c70510f50', '79785c1c-5e09-4634-926e-acbd47794c60', '97593bb2-011c-48ce-8e08-df2d8786113a'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:17 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:09:17 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:17 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.292s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:09:17 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Deleted volume successfully. Nov 04 19:09:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b3514542-f3b3-471c-8c02-0f1ea6c6b9a1 tempest-SnapshotDependencyTests-729545247 None] Lock "cinder-3bffb8b1-72d3-4b0b-9412-bd11c4d0fdd6-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:09:27 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=40,cinder:INSERT=7,cinder:DELETE=3,cinder:SELECT=28 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:09:27 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=33,cinder:UPDATE=34,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Flow 'volume_create_manager' (8929f907-0c30-4573-8cdc-aed271838180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6526b189-b1c1-4f04-9858-eaf2cd2947e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6526b189-b1c1-4f04-9858-eaf2cd2947e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-451551484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026e70fd-8312-4a98-9219-b17a492e0206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a485ba1a284353bc1bb8c8bd8bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:46Z,use_quota=True,user_id='1e0bf9ba3ae140278ff250be1c0afbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8dd136-a80a-42d3-afb4-cd043fb1875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8dd136-a80a-42d3-afb4-cd043fb1875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba9607a-fd2e-4468-accf-432c8262cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba9607a-fd2e-4468-accf-432c8262cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '026e70fd-8312-4a98-9219-b17a492e0206', 'volume_name': 'volume-026e70fd-8312-4a98-9219-b17a492e0206', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60229513-d31d-4393-ba83-31691f56f8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60229513-d31d-4393-ba83-31691f56f8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee0738c-2000-406e-8c5d-9424d7fbbf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:46 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Volume 026e70fd-8312-4a98-9219-b17a492e0206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-026e70fd-8312-4a98-9219-b17a492e0206', 'volume_size': 1} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-451551484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026e70fd-8312-4a98-9219-b17a492e0206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a485ba1a284353bc1bb8c8bd8bae4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:09:46Z,use_quota=True,user_id='1e0bf9ba3ae140278ff250be1c0afbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Creating volume 026e70fd-8312-4a98-9219-b17a492e0206 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:09:46 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:46 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 1073741824 Nov 04 19:09:46 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:46 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 1073741824" returned: 0 in 0.387s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:46 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 Nov 04 19:09:46 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:46 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206" returned: 0 in 0.247s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee0738c-2000-406e-8c5d-9424d7fbbf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-026e70fd-8312-4a98-9219-b17a492e0206', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfd247e-5015-4456-97e1-4ef3e83a5927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:09:46 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Volume volume-026e70fd-8312-4a98-9219-b17a492e0206 (026e70fd-8312-4a98-9219-b17a492e0206): created successfully Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfd247e-5015-4456-97e1-4ef3e83a5927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:09:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Flow 'volume_create_manager' (8929f907-0c30-4573-8cdc-aed271838180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:09:46 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0b5e5969-905a-4aab-8915-ed2b9e2eb18f tempest-TestImageHashVerification-1311620152 None] Created volume successfully. Nov 04 19:09:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:09:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:09:47 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ab3ceb-040a-4c75-b481-b184b5097cf1]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:47 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 Nov 04 19:09:47 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:48 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206" returned: 0 in 0.346s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:48 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a224a96b-3637-41d1-ad65-844db0aea2bc]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:48 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 Nov 04 19:09:48 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:48 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206" returned: 0 in 0.342s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 /opt/stack/data/cinder/conversion/026e70fd-8312-4a98-9219-b17a492e0206.temp_image.42549415-b913-4f93-b030-b23cb92261c6n3ftw1s5.img {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:48 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 /opt/stack/data/cinder/conversion/026e70fd-8312-4a98-9219-b17a492e0206.temp_image.42549415-b913-4f93-b030-b23cb92261c6n3ftw1s5.img Nov 04 19:09:48 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:54 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 /opt/stack/data/cinder/conversion/026e70fd-8312-4a98-9219-b17a492e0206.temp_image.42549415-b913-4f93-b030-b23cb92261c6n3ftw1s5.img" returned: 0 in 5.679s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:54 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c763642-9ecb-4280-b0e9-809c90efeb51]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:09:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:09:54 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 Nov 04 19:09:54 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:09:54 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Nov 04 19:09:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206" returned: 0 in 0.583s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:09:54 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/conversion/026e70fd-8312-4a98-9219-b17a492e0206.temp_image.42549415-b913-4f93-b030-b23cb92261c6n3ftw1s5.img {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:09:54 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] Converted 1024.00 MB image at 180.27 MB/s Nov 04 19:09:54 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] 42549415-b913-4f93-b030-b23cb92261c6 was raw, no need to convert to raw {{(pid=87364) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 04 19:10:04 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:10:04 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:10:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.897s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] Uploaded volume to glance image-id: 42549415-b913-4f93-b030-b23cb92261c6. {{(pid=87364) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 04 19:10:13 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1423a1e0-0963-4e69-9441-3fbf2fd4dee3 tempest-TestImageHashVerification-1311620152 None] Copy volume to image completed successfully. Nov 04 19:10:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Acquiring lock "cinder-026e70fd-8312-4a98-9219-b17a492e0206-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Lock "cinder-026e70fd-8312-4a98-9219-b17a492e0206-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Acquiring lock "cinder-quobyte-026e70fd-8312-4a98-9219-b17a492e0206" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Lock "cinder-quobyte-026e70fd-8312-4a98-9219-b17a492e0206" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:14 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37a471a-08aa-4316-b512-b24b78b950ca]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:14 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 Nov 04 19:10:14 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:14 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206" returned: 0 in 0.412s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:14 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206 Nov 04 19:10:14 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:15 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-026e70fd-8312-4a98-9219-b17a492e0206" returned: 0 in 0.277s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Lock "cinder-quobyte-026e70fd-8312-4a98-9219-b17a492e0206" released by "delete_volume" :: held 0.728s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Created reservations ['fa69f8aa-e57a-4d67-a8cb-cf6c1e93064d', '4c284d67-1df3-40d6-a296-c4e6fb667da9', '851a2025-79b4-4417-a8ab-97a7784bea7d', '1da31e38-0d6b-4b55-abe5-8cb30dd303c5'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:15 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:10:15 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:15 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.293s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:10:15 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Deleted volume successfully. Nov 04 19:10:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c749fbc7-e428-46f5-bbee-4c6618e610b7 tempest-TestImageHashVerification-1311620152 None] Lock "cinder-026e70fd-8312-4a98-9219-b17a492e0206-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:16 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:10:16 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:16 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.262s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:10:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:10:25 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:10:25 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Flow 'volume_create_manager' (c7eb2699-0769-4b1b-886c-1d27d5b5c9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f1ea00-00bf-48bc-837e-17710be3356e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f1ea00-00bf-48bc-837e-17710be3356e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-954284168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad65d15-4692-4ac2-be29-bbcbacfb9a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a38c32186ef4dfda4d860c45d68aca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:10:28Z,use_quota=True,user_id='5f8c36d503174a6185c1d8a13f5e5a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c9a6f3-7f2e-418f-948d-d94b90cea469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c9a6f3-7f2e-418f-948d-d94b90cea469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3744c58-e001-40b0-95ef-0ddc9715ceb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3744c58-e001-40b0-95ef-0ddc9715ceb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad65d15-4692-4ac2-be29-bbcbacfb9a07', 'volume_name': 'volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7562e788-8e87-49ea-9610-4fe71620064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7562e788-8e87-49ea-9610-4fe71620064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445c7be9-1ec5-44ec-991e-a1967d92326f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:28 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Volume fad65d15-4692-4ac2-be29-bbcbacfb9a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07', 'volume_size': 1} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-954284168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad65d15-4692-4ac2-be29-bbcbacfb9a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a38c32186ef4dfda4d860c45d68aca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:10:28Z,use_quota=True,user_id='5f8c36d503174a6185c1d8a13f5e5a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Creating volume fad65d15-4692-4ac2-be29-bbcbacfb9a07 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:10:28 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:28 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 1073741824 Nov 04 19:10:28 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:28 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 1073741824" returned: 0 in 0.414s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:28 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 Nov 04 19:10:28 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:29 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07" returned: 0 in 0.257s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445c7be9-1ec5-44ec-991e-a1967d92326f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d3110a-c1ca-4c52-9af6-a609ec2f75f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:29 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Volume volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 (fad65d15-4692-4ac2-be29-bbcbacfb9a07): created successfully Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d3110a-c1ca-4c52-9af6-a609ec2f75f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Flow 'volume_create_manager' (c7eb2699-0769-4b1b-886c-1d27d5b5c9b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:29 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8acffd41-d542-4cf0-bb3a-72429db0a5a4 tempest-VolumeDependencyTests-1100901937 None] Created volume successfully. Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] Creating offline snapshot 2c52a460-b51a-4215-bbf7-435552b625d0 of volume fad65d15-4692-4ac2-be29-bbcbacfb9a07 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[10af7d00-fd20-43fb-95ff-3bfe98d7970a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:29 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 Nov 04 19:10:29 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:30 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07" returned: 0 in 0.383s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:30 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 1G Nov 04 19:10:30 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:30 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 1G" returned: 0 in 0.401s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:30 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 Nov 04 19:10:30 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:30 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0" returned: 0 in 0.285s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:30 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 is being set with open permissions: ugo+rw Nov 04 19:10:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:30 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 Nov 04 19:10:30 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:30 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0" returned: 0 in 0.243s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:31 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.info Nov 04 19:10:31 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:31 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.info" returned: 0 in 0.249s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:31 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.info is being set with open permissions: ugo+rw Nov 04 19:10:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:31 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.info Nov 04 19:10:31 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:31 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.info" returned: 0 in 0.265s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8b93487b-a444-4860-a5ed-076c4e7bb5ee tempest-VolumeDependencyTests-1100901937 None] Create snapshot completed successfully Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Flow 'volume_create_manager' (7c60799b-fa17-4f6a-bcfc-7d57bbcbbab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec13676a-795d-4f07-adfc-5411d69397ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec13676a-795d-4f07-adfc-5411d69397ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1479284441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ba5a20-8dfa-4f27-97b7-89f18df74c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a38c32186ef4dfda4d860c45d68aca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2c52a460-b51a-4215-bbf7-435552b625d0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:10:36Z,use_quota=True,user_id='5f8c36d503174a6185c1d8a13f5e5a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea86722-ca45-4e77-bd5f-9e3cc8f75515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea86722-ca45-4e77-bd5f-9e3cc8f75515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48dc2f57-1b33-4f4a-97cf-5dccf8f2075a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48dc2f57-1b33-4f4a-97cf-5dccf8f2075a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b0ba5a20-8dfa-4f27-97b7-89f18df74c21', 'volume_name': 'volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21', 'volume_size': 1, 'snapshot_id': '2c52a460-b51a-4215-bbf7-435552b625d0'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b41e6e7-0548-48e6-8f2f-fc1c93bf8a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b41e6e7-0548-48e6-8f2f-fc1c93bf8a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3001a171-d54b-4ef6-9a99-d97566d948e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:36 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Volume b0ba5a20-8dfa-4f27-97b7-89f18df74c21: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21', 'volume_size': 1, 'snapshot_id': '2c52a460-b51a-4215-bbf7-435552b625d0'} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "cinder-quobyte-2c52a460-b51a-4215-bbf7-435552b625d0-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" by "_create_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-2c52a460-b51a-4215-bbf7-435552b625d0-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Creating volume b0ba5a20-8dfa-4f27-97b7-89f18df74c21 from snapshot 2c52a460-b51a-4215-bbf7-435552b625d0 {{(pid=87364) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "cinder-quobyte-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] snapshot: 2c52a460-b51a-4215-bbf7-435552b625d0, volume: b0ba5a20-8dfa-4f27-97b7-89f18df74c21, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0f9692-d65e-4fa3-81a5-c475db488be2]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:36 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 Nov 04 19:10:36 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:36 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0" returned: 0 in 0.348s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e899d87-d0aa-4b79-a41e-63e49e1f5b0c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:36 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 Nov 04 19:10:36 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:36 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07" returned: 0 in 0.343s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:10:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:10:37 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:10:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:37 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 Nov 04 19:10:37 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:42 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" returned: 0 in 5.749s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:42 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:10:42 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Converted 1024.00 MB image at 178.08 MB/s Nov 04 19:10:42 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 is being set with open permissions: ugo+rw Nov 04 19:10:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:42 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 Nov 04 19:10:42 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:42 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" returned: 0 in 0.238s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" released by "_copy_volume_from_snapshot" :: held 6.756s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-2c52a460-b51a-4215-bbf7-435552b625d0-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" released by "_create_volume_from_snapshot" :: held 6.812s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.830s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3001a171-d54b-4ef6-9a99-d97566d948e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21', 'volume_size': 1, 'snapshot_id': '2c52a460-b51a-4215-bbf7-435552b625d0'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599aa918-2a3f-4339-8398-935bcbd46726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:43 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Volume volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 (b0ba5a20-8dfa-4f27-97b7-89f18df74c21): created successfully Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599aa918-2a3f-4339-8398-935bcbd46726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Flow 'volume_create_manager' (7c60799b-fa17-4f6a-bcfc-7d57bbcbbab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:43 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-54e81234-e132-4e32-b2bd-34cff066dbc1 tempest-VolumeDependencyTests-1100901937 None] Created volume successfully. Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "cinder-2c52a460-b51a-4215-bbf7-435552b625d0-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-2c52a460-b51a-4215-bbf7-435552b625d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "cinder-quobyte-fad65d15-4692-4ac2-be29-bbcbacfb9a07" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-fad65d15-4692-4ac2-be29-bbcbacfb9a07" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "cinder-quobyte-2c52a460-b51a-4215-bbf7-435552b625d0" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-2c52a460-b51a-4215-bbf7-435552b625d0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Deleting offline snapshot 2c52a460-b51a-4215-bbf7-435552b625d0 of volume fad65d15-4692-4ac2-be29-bbcbacfb9a07 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] snapshot_file for this snap is: volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e5a486-9c9a-4c6c-ac22-007ab44b767e]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:43 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 Nov 04 19:10:43 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:44 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0" returned: 0 in 0.359s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:10:44 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b93378a-e4f9-4999-8c99-178908dae24b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:44 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 Nov 04 19:10:44 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:44 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07" returned: 0 in 0.528s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:44 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 Nov 04 19:10:44 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:45 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0" returned: 0 in 0.323s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:45 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0 Nov 04 19:10:45 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:45 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07.2c52a460-b51a-4215-bbf7-435552b625d0" returned: 0 in 0.252s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-2c52a460-b51a-4215-bbf7-435552b625d0" released by "_delete_snapshot" :: held 1.569s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-fad65d15-4692-4ac2-be29-bbcbacfb9a07" released by "delete_snapshot" :: held 1.592s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:45 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Created reservations ['4b5be413-8d00-4378-946a-3ed496d16072', '0f6f22f0-6930-4fce-8923-8621f5a07644', 'e7c2eabf-8b4e-4d8c-8cd5-ab494ff3a9ff', '15eeeb27-1d73-435b-8dfd-633b2635f157'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:10:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Delete snapshot completed successfully. Nov 04 19:10:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6eab48c1-e7c0-456d-abb5-4b8d65ee3744 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-2c52a460-b51a-4215-bbf7-435552b625d0-delete_snapshot" released by "delete_snapshot" :: held 1.732s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "cinder-fad65d15-4692-4ac2-be29-bbcbacfb9a07-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-fad65d15-4692-4ac2-be29-bbcbacfb9a07-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "cinder-quobyte-fad65d15-4692-4ac2-be29-bbcbacfb9a07" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-fad65d15-4692-4ac2-be29-bbcbacfb9a07" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[71821f46-58ef-421d-84b5-b8f3212c4788]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:46 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 Nov 04 19:10:46 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:46 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07" returned: 0 in 0.366s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:46 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07 Nov 04 19:10:46 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:46 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-fad65d15-4692-4ac2-be29-bbcbacfb9a07" returned: 0 in 0.234s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-fad65d15-4692-4ac2-be29-bbcbacfb9a07" released by "delete_volume" :: held 0.660s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Created reservations ['c17a5cc7-3e9a-4921-b230-5bd7c4f76124', '2ac45f0d-325b-4604-b480-fce38a87e9fb', '07c015fc-35df-4435-ae3e-ef64db390efe', '77c80ada-5099-4f7a-bc81-9ddd5e2fabc4'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:46 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:10:46 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:46 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.237s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:10:47 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Deleted volume successfully. Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-085321fa-d90c-4164-8989-e3e76f08e2ed tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-fad65d15-4692-4ac2-be29-bbcbacfb9a07-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "cinder-b0ba5a20-8dfa-4f27-97b7-89f18df74c21-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-b0ba5a20-8dfa-4f27-97b7-89f18df74c21-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "cinder-quobyte-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" acquired by "delete_volume" :: waited 0.014s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4290276-53bf-4eb8-baae-bbedb5d399cd]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:47 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 Nov 04 19:10:47 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:47 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" returned: 0 in 0.391s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:47 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21 Nov 04 19:10:47 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:47 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" returned: 0 in 0.241s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-quobyte-b0ba5a20-8dfa-4f27-97b7-89f18df74c21" released by "delete_volume" :: held 0.670s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Created reservations ['88ff75a5-3938-4eeb-9633-207570552c4d', '692bfdc1-d972-4a35-a56f-70bcd5246d8e', '53d6872c-476c-435d-8fc5-207f5cc56f11', '5062ce87-583e-4704-90c2-874dedf32ce3'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:47 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:10:47 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:48 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.250s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:48 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:10:48 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Deleted volume successfully. Nov 04 19:10:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-db55bdbd-224a-4fa4-93cf-80c628f3c6d1 tempest-VolumeDependencyTests-1100901937 None] Lock "cinder-b0ba5a20-8dfa-4f27-97b7-89f18df74c21-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Flow 'volume_create_manager' (3f8f3ce7-16cc-4964-aa15-201cd47f8250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edd07b1-ce29-4989-bb46-2f4938095db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edd07b1-ce29-4989-bb46-2f4938095db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a8c4d0-89e8-411a-a1e1-32bddcf93e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4282fb6284acf8219f6565deced1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:10:53Z,use_quota=True,user_id='73da2a56e247402a9424dcc24d4fdd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b79f6f-1156-4069-a526-f7fd2aa791e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b79f6f-1156-4069-a526-f7fd2aa791e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c675e57d-341f-4bfb-8cb5-d058c82a8b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.image.glance [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Creating Keystone auth plugin from conf {{(pid=87364) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c675e57d-341f-4bfb-8cb5-d058c82a8b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0a8c4d0-89e8-411a-a1e1-32bddcf93e63', 'volume_name': 'volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63', 'volume_size': 1, 'image_id': '8125258d-5194-4b63-acd8-b74990efe822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8125258d-5194-4b63-acd8-b74990efe822', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9bd6ee7cfab81d4d659a4fbeb18cfc87', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '65e4282fb6284acf8219f6565deced1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '542596a47f29ed9137685eca7781c377b9749737a31360deb6a3bb6d6ac4749b648081361d2aeabfb94609ceedf312d0675311727a8315437d3848246f17592e', 'id': '8125258d-5194-4b63-acd8-b74990efe822', 'created_at': datetime.datetime(2026, 11, 4, 18, 10, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 10, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8125258d-5194-4b63-acd8-b74990efe822/file', 'properties': {}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049fa2e7-7a1e-4c53-a4e1-9bc922fb929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049fa2e7-7a1e-4c53-a4e1-9bc922fb929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b78840-41dd-4c38-9040-f7a8e0b2d24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:53 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Volume d0a8c4d0-89e8-411a-a1e1-32bddcf93e63: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63', 'volume_size': 1, 'image_id': '8125258d-5194-4b63-acd8-b74990efe822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8125258d-5194-4b63-acd8-b74990efe822', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9bd6ee7cfab81d4d659a4fbeb18cfc87', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '65e4282fb6284acf8219f6565deced1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '542596a47f29ed9137685eca7781c377b9749737a31360deb6a3bb6d6ac4749b648081361d2aeabfb94609ceedf312d0675311727a8315437d3848246f17592e', 'id': '8125258d-5194-4b63-acd8-b74990efe822', 'created_at': datetime.datetime(2026, 11, 4, 18, 10, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 10, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8125258d-5194-4b63-acd8-b74990efe822/file', 'properties': {}}, 'image_service': } Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Trying to clone d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 from image 8125258d-5194-4b63-acd8-b74990efe822 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8125258d-5194-4b63-acd8-b74990efe822', 'metadata': {}}]). {{(pid=87364) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:10:53 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f8d50b-44c3-4097-aa98-2a1ec34e88db]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:53 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD Nov 04 19:10:53 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:54 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:54 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD Nov 04 19:10:54 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:54 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:10:54 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Temporary image 8125258d-5194-4b63-acd8-b74990efe822 is fetched for user 73da2a56e247402a9424dcc24d4fdd96. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:10:54 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba31a2c-4e25-48d1-a9c9-c65dccc0e3f5]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:54 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD Nov 04 19:10:54 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:54 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:54 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD Nov 04 19:10:54 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:55 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD" returned: 1 in 0.323s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a8c4d0-89e8-411a-a1e1-32bddcf93e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4282fb6284acf8219f6565deced1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:10:53Z,use_quota=True,user_id='73da2a56e247402a9424dcc24d4fdd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Creating volume d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:10:55 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:55 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 1073741824 Nov 04 19:10:55 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:55 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 1073741824" returned: 0 in 0.412s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:55 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 Nov 04 19:10:55 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:55 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63" returned: 0 in 0.263s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Attempting download of 8125258d-5194-4b63-acd8-b74990efe822 ((None, [{'url': 'file:///opt/stack/data/glance/images/8125258d-5194-4b63-acd8-b74990efe822', 'metadata': {}}])) to volume d0a8c4d0-89e8-411a-a1e1-32bddcf93e63. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c76204-3c1a-4f87-83d5-67d1c53854ba]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8125258d-5194-4b63-acd8-b74990efe822_tk7m5f5m {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:56 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8125258d-5194-4b63-acd8-b74990efe822_tk7m5f5m Nov 04 19:10:56 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:56 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8125258d-5194-4b63-acd8-b74990efe822_tk7m5f5m" returned: 0 in 0.323s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8125258d-5194-4b63-acd8-b74990efe822_tk7m5f5m {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:56 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8125258d-5194-4b63-acd8-b74990efe822_tk7m5f5m Nov 04 19:10:56 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:56 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8125258d-5194-4b63-acd8-b74990efe822_tk7m5f5m" returned: 1 in 0.326s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8125258d-5194-4b63-acd8-b74990efe822_tk7m5f5m' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:10:56 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e91c56-c42a-4a91-84d1-4e7a6889d187]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:56 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD Nov 04 19:10:56 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:56 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:57 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD Nov 04 19:10:57 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:57 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD" returned: 1 in 0.333s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:10:57 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] 8125258d-5194-4b63-acd8-b74990efe822 was raw, converting to qcow2 {{(pid=87364) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:10:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:57 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 Nov 04 19:10:57 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:57 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63" returned: 0 in 0.452s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:57 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8125258d-5194-4b63-acd8-b74990efe822_2qmdc_videvstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:10:57 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:10:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:57 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 1G Nov 04 19:10:57 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:58 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 1G" returned: 0 in 0.323s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Downloaded image 8125258d-5194-4b63-acd8-b74990efe822 ((None, [{'url': 'file:///opt/stack/data/glance/images/8125258d-5194-4b63-acd8-b74990efe822', 'metadata': {}}])) to volume d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 successfully. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Temporary image 8125258d-5194-4b63-acd8-b74990efe822 for user 73da2a56e247402a9424dcc24d4fdd96 is deleted. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Marking volume d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 as bootable. {{(pid=87364) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Copying metadata from image 8125258d-5194-4b63-acd8-b74990efe822 to d0a8c4d0-89e8-411a-a1e1-32bddcf93e63. {{(pid=87364) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Creating volume glance metadata for volume d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 backed by image 8125258d-5194-4b63-acd8-b74990efe822 with: {'image_id': '8125258d-5194-4b63-acd8-b74990efe822', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9bd6ee7cfab81d4d659a4fbeb18cfc87', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87364) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b78840-41dd-4c38-9040-f7a8e0b2d24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63', 'volume_size': 1, 'image_id': '8125258d-5194-4b63-acd8-b74990efe822', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8125258d-5194-4b63-acd8-b74990efe822', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9bd6ee7cfab81d4d659a4fbeb18cfc87', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '65e4282fb6284acf8219f6565deced1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '542596a47f29ed9137685eca7781c377b9749737a31360deb6a3bb6d6ac4749b648081361d2aeabfb94609ceedf312d0675311727a8315437d3848246f17592e', 'id': '8125258d-5194-4b63-acd8-b74990efe822', 'created_at': datetime.datetime(2026, 11, 4, 18, 10, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 10, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8125258d-5194-4b63-acd8-b74990efe822/file', 'properties': {}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81c220e-1107-4a81-a524-b8c1aadc8077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:10:58 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Volume volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 (d0a8c4d0-89e8-411a-a1e1-32bddcf93e63): created successfully Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81c220e-1107-4a81-a524-b8c1aadc8077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Flow 'volume_create_manager' (3f8f3ce7-16cc-4964-aa15-201cd47f8250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:10:58 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-00b1c242-bcf3-4a6c-9a51-9a0d90e585a0 tempest-VolumeImageDependencyTests-935116971 None] Created volume successfully. Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Acquiring lock "cinder-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Lock "cinder-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Acquiring lock "cinder-quobyte-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Lock "cinder-quobyte-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[281937c0-11c1-49b3-8c68-17c21b386d5b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:10:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:58 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 Nov 04 19:10:58 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:59 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63" returned: 0 in 0.387s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:59 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63 Nov 04 19:10:59 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:59 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63" returned: 0 in 0.252s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Lock "cinder-quobyte-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63" released by "delete_volume" :: held 0.682s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Created reservations ['37d5d2f9-afbb-49ee-8ab9-90b772e1f4f0', '73f4bfbc-e390-4b50-9ceb-7484c3a22239', 'bed6e55d-57d4-4ac7-a431-0dcc44b5c537', 'f7402c5e-a5c7-4317-95f8-1e082e87cd57'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:10:59 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:10:59 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:10:59 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.260s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:10:59 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Deleted volume successfully. Nov 04 19:10:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-52af1ea2-fc39-4646-bdfa-a14883c0f172 tempest-VolumeImageDependencyTests-935116971 None] Lock "cinder-d0a8c4d0-89e8-411a-a1e1-32bddcf93e63-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:02 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:02 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Flow 'volume_create_manager' (0ba2c88f-5087-46be-9dd3-29db76c5e544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f655f94-a037-4761-89e3-21b79b6f8e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f655f94-a037-4761-89e3-21b79b6f8e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55bda8af-933a-4602-a73c-558ce6809614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77deb0048af444d081b3c5d8f25ee714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:03Z,use_quota=True,user_id='b1147a0dfe46494fb8f5e31eca487dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd03a988-d84f-47fd-a15e-a72269a3a599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd03a988-d84f-47fd-a15e-a72269a3a599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be430cff-550e-43d8-946e-a2be71550c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be430cff-550e-43d8-946e-a2be71550c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55bda8af-933a-4602-a73c-558ce6809614', 'volume_name': 'volume-55bda8af-933a-4602-a73c-558ce6809614', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18fa31d3-cf4b-4624-a133-b4c253cfd972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18fa31d3-cf4b-4624-a133-b4c253cfd972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096ccd7a-c92e-47aa-a5fe-f23438f57110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:03 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Volume 55bda8af-933a-4602-a73c-558ce6809614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55bda8af-933a-4602-a73c-558ce6809614', 'volume_size': 1} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55bda8af-933a-4602-a73c-558ce6809614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77deb0048af444d081b3c5d8f25ee714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:03Z,use_quota=True,user_id='b1147a0dfe46494fb8f5e31eca487dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Creating volume 55bda8af-933a-4602-a73c-558ce6809614 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:03 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:03 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614 1073741824 Nov 04 19:11:03 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:03 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614 1073741824" returned: 0 in 0.419s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:03 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614 Nov 04 19:11:03 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:03 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614" returned: 0 in 0.231s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096ccd7a-c92e-47aa-a5fe-f23438f57110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55bda8af-933a-4602-a73c-558ce6809614', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb0e6f5-81fe-4b8f-ae9c-bf398b241a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:03 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Volume volume-55bda8af-933a-4602-a73c-558ce6809614 (55bda8af-933a-4602-a73c-558ce6809614): created successfully Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb0e6f5-81fe-4b8f-ae9c-bf398b241a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Flow 'volume_create_manager' (0ba2c88f-5087-46be-9dd3-29db76c5e544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:03 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-efb9a2a8-8810-45cf-b55f-37c35404606c tempest-CinderUnicodeTest-1621649444 None] Created volume successfully. Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Flow 'volume_create_manager' (d2d0349d-9a14-4250-b0a5-d458f880d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b48ca5c-ec1a-4d25-9ea6-5472a72842b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b48ca5c-ec1a-4d25-9ea6-5472a72842b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2102448222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15dd1bb0-c228-43d7-9711-5a0ed1bc32db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77deb0048af444d081b3c5d8f25ee714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:04Z,use_quota=True,user_id='b1147a0dfe46494fb8f5e31eca487dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4f0ed3-c73f-4731-bad6-aafd030e1217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4f0ed3-c73f-4731-bad6-aafd030e1217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ee26a9-fd05-4d59-a7a2-bc2a3cef9b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ee26a9-fd05-4d59-a7a2-bc2a3cef9b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15dd1bb0-c228-43d7-9711-5a0ed1bc32db', 'volume_name': 'volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88216da-9c18-4a53-8ffc-990ca95ffc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88216da-9c18-4a53-8ffc-990ca95ffc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89232070-e49e-4d29-a04e-c5938028a81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:04 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Volume 15dd1bb0-c228-43d7-9711-5a0ed1bc32db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db', 'volume_size': 1} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2102448222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15dd1bb0-c228-43d7-9711-5a0ed1bc32db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77deb0048af444d081b3c5d8f25ee714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:04Z,use_quota=True,user_id='b1147a0dfe46494fb8f5e31eca487dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Creating volume 15dd1bb0-c228-43d7-9711-5a0ed1bc32db {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:04 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:04 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db 1073741824 Nov 04 19:11:04 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:04 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db 1073741824" returned: 0 in 0.421s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:05 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db Nov 04 19:11:05 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:05 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db" returned: 0 in 0.270s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89232070-e49e-4d29-a04e-c5938028a81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c510370c-e8c3-4eb8-8412-d2e5ab0170a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:05 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Volume volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db (15dd1bb0-c228-43d7-9711-5a0ed1bc32db): created successfully Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c510370c-e8c3-4eb8-8412-d2e5ab0170a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Flow 'volume_create_manager' (d2d0349d-9a14-4250-b0a5-d458f880d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-75bbd759-65df-49fb-b8ef-c226c13c5e2b tempest-CinderUnicodeTest-1621649444 None] Created volume successfully. Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] Creating offline snapshot c50694f2-b583-494a-aa6c-22ceec96257d of volume 15dd1bb0-c228-43d7-9711-5a0ed1bc32db {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42d05af-a3c4-4d82-8d3f-0cc779e00692]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:05 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db Nov 04 19:11:05 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:06 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db" returned: 0 in 0.364s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:06 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d 1G Nov 04 19:11:06 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:06 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d 1G" returned: 0 in 0.402s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:06 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d Nov 04 19:11:06 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:06 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d" returned: 0 in 0.294s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:06 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d is being set with open permissions: ugo+rw Nov 04 19:11:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:06 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d Nov 04 19:11:06 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:07 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d" returned: 0 in 0.240s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:07 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.info Nov 04 19:11:07 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:07 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.info" returned: 0 in 0.250s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:07 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.info is being set with open permissions: ugo+rw Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:07 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.info Nov 04 19:11:07 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:07 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.info" returned: 0 in 0.233s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:07 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-06ecf4e1-ea8f-491a-aae7-4cb5aa86c2cf tempest-CinderUnicodeTest-1621649444 None] Create snapshot completed successfully Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "cinder-c50694f2-b583-494a-aa6c-22ceec96257d-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-c50694f2-b583-494a-aa6c-22ceec96257d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "cinder-quobyte-15dd1bb0-c228-43d7-9711-5a0ed1bc32db" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-quobyte-15dd1bb0-c228-43d7-9711-5a0ed1bc32db" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "cinder-quobyte-c50694f2-b583-494a-aa6c-22ceec96257d" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-quobyte-c50694f2-b583-494a-aa6c-22ceec96257d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Deleting offline snapshot c50694f2-b583-494a-aa6c-22ceec96257d of volume 15dd1bb0-c228-43d7-9711-5a0ed1bc32db {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] snapshot_file for this snap is: volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[337b24b0-abec-419f-80ee-d3b30face32b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:08 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d Nov 04 19:11:08 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:08 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d" returned: 0 in 0.350s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:08 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:11:08 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1cf6ca-450d-4d13-a282-767397f7a2bb]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:08 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db Nov 04 19:11:08 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:08 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db" returned: 0 in 0.338s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:08 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d Nov 04 19:11:08 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:08 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d" returned: 0 in 0.330s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:09 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d Nov 04 19:11:09 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:09 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db.c50694f2-b583-494a-aa6c-22ceec96257d" returned: 0 in 0.234s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-quobyte-c50694f2-b583-494a-aa6c-22ceec96257d" released by "_delete_snapshot" :: held 1.358s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-quobyte-15dd1bb0-c228-43d7-9711-5a0ed1bc32db" released by "delete_snapshot" :: held 1.379s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:09 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Created reservations ['5c2330b8-a254-43ea-8172-6b06841f4db5', '039f76d1-2f03-493a-879f-0d190ca8b467', '2845d5c6-ed63-492c-954f-1378dbd526a1', '8db6a4c2-6405-4ef8-a2b6-7279cfb805f8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:09 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Delete snapshot completed successfully. Nov 04 19:11:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-300d99f4-ad91-4155-84f6-cfdbf481e41e tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-c50694f2-b583-494a-aa6c-22ceec96257d-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "cinder-15dd1bb0-c228-43d7-9711-5a0ed1bc32db-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-15dd1bb0-c228-43d7-9711-5a0ed1bc32db-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "cinder-quobyte-15dd1bb0-c228-43d7-9711-5a0ed1bc32db" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-quobyte-15dd1bb0-c228-43d7-9711-5a0ed1bc32db" acquired by "delete_volume" :: waited 0.013s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c1f00-6890-4680-a6ab-a879828dd86e]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:10 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db Nov 04 19:11:10 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:10 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db" returned: 0 in 0.374s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:10 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db Nov 04 19:11:10 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:10 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-15dd1bb0-c228-43d7-9711-5a0ed1bc32db" returned: 0 in 0.253s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-quobyte-15dd1bb0-c228-43d7-9711-5a0ed1bc32db" released by "delete_volume" :: held 0.688s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Created reservations ['7060037c-a5ff-46e2-aba4-fb47e5873958', '560d8b80-8169-4532-8ea6-4abf1a8ee5fd', 'adae841c-7976-41f4-8153-d979c09867ff', 'a8516bb4-4712-4c96-a62b-c910bb7dd457'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:10 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:10 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:11 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.241s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:11 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Deleted volume successfully. Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ea5c10c6-4573-403d-902c-41aadeab3a5c tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-15dd1bb0-c228-43d7-9711-5a0ed1bc32db-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "cinder-55bda8af-933a-4602-a73c-558ce6809614-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-55bda8af-933a-4602-a73c-558ce6809614-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "cinder-quobyte-55bda8af-933a-4602-a73c-558ce6809614" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-quobyte-55bda8af-933a-4602-a73c-558ce6809614" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4658c99-e127-425c-8348-2781ec29658c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:11 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614 Nov 04 19:11:11 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:11 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614" returned: 0 in 0.360s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:11 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614 Nov 04 19:11:11 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:11 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-55bda8af-933a-4602-a73c-558ce6809614" returned: 0 in 0.256s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-quobyte-55bda8af-933a-4602-a73c-558ce6809614" released by "delete_volume" :: held 0.655s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:12 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Created reservations ['8a2a9546-40e4-4b2e-bfe1-498d049ff665', '5860fdeb-828b-4807-8ff0-94ea981fb411', 'ba23dc4b-c713-4a60-95ff-21981f494956', '6d7a8f77-9e63-4730-a5d8-81d9f4e790d9'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:12 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:12 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:12 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.249s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:12 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:12 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Deleted volume successfully. Nov 04 19:11:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-92a816c8-a27c-4545-bb23-e634ee7f42fe tempest-CinderUnicodeTest-1621649444 None] Lock "cinder-55bda8af-933a-4602-a73c-558ce6809614-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:16 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:16 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:16 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.258s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:11:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:11:22 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=73,cinder:INSERT=20,cinder:DELETE=5,cinder:SELECT=65 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:11:22 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=55,cinder:UPDATE=68,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Flow 'volume_create_manager' (3f776b0a-252a-4e3d-92b6-fa7eb4509aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dee19c-b877-47c8-a638-432faa15d6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dee19c-b877-47c8-a638-432faa15d6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1673269797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f401455-2af5-4649-8ccd-7e6a98cb803f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76a1939074d46cdb72e0a8c6c1b305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:33Z,use_quota=True,user_id='5095a41f134f4e8a86db4afc11fb6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d06fb4-defc-4ddc-8758-9fd140d2e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d06fb4-defc-4ddc-8758-9fd140d2e96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c493eaa5-f8d4-4a23-86aa-956e5d89e256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c493eaa5-f8d4-4a23-86aa-956e5d89e256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f401455-2af5-4649-8ccd-7e6a98cb803f', 'volume_name': 'volume-8f401455-2af5-4649-8ccd-7e6a98cb803f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43aa0401-9e35-45a7-8bd3-4ad65d95c40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43aa0401-9e35-45a7-8bd3-4ad65d95c40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93d858c-d009-48ca-9d3b-6993f199c917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:33 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Volume 8f401455-2af5-4649-8ccd-7e6a98cb803f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f401455-2af5-4649-8ccd-7e6a98cb803f', 'volume_size': 1} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1673269797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f401455-2af5-4649-8ccd-7e6a98cb803f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76a1939074d46cdb72e0a8c6c1b305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:33Z,use_quota=True,user_id='5095a41f134f4e8a86db4afc11fb6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Creating volume 8f401455-2af5-4649-8ccd-7e6a98cb803f {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:33 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:33 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f 1073741824 Nov 04 19:11:33 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (09804990-20d4-4ce7-a504-ef2977860d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db12681-b188-47b0-91ca-18bd50147356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db12681-b188-47b0-91ca-18bd50147356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1210536880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f77e35-7751-4cc5-a834-4657e6b30e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:34Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed595a84-40ee-466e-963d-40a409e3886f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed595a84-40ee-466e-963d-40a409e3886f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034a80c1-3d76-4103-9ad6-00b70a4f8940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034a80c1-3d76-4103-9ad6-00b70a4f8940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f77e35-7751-4cc5-a834-4657e6b30e26', 'volume_name': 'volume-01f77e35-7751-4cc5-a834-4657e6b30e26', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d7d034-7197-460d-9ba2-b376f7c2a1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d7d034-7197-460d-9ba2-b376f7c2a1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1820feb-3d7f-46a7-96e1-7e7c426bbb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:33 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume 01f77e35-7751-4cc5-a834-4657e6b30e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f77e35-7751-4cc5-a834-4657e6b30e26', 'volume_size': 1} Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:33 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f 1073741824" returned: 0 in 0.737s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Flow 'volume_create_manager' (45cf3b20-fcba-4b7e-b8ba-4cbcaaf1dfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7982f1-8b88-4288-bfe5-676f5c29270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:34 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f Nov 04 19:11:34 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7982f1-8b88-4288-bfe5-676f5c29270f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-844879832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfbb885-2401-41b1-8326-6460f9219a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76a1939074d46cdb72e0a8c6c1b305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:34Z,use_quota=True,user_id='5095a41f134f4e8a86db4afc11fb6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f454ae75-8f19-4039-b977-7783ff528934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f454ae75-8f19-4039-b977-7783ff528934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d747f2a5-89b5-4fb9-b35e-5e562aae2c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d747f2a5-89b5-4fb9-b35e-5e562aae2c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bfbb885-2401-41b1-8326-6460f9219a35', 'volume_name': 'volume-0bfbb885-2401-41b1-8326-6460f9219a35', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a07d039-909d-413c-85c8-10a093027beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a07d039-909d-413c-85c8-10a093027beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5072b3-4b62-4848-81de-f4969dd5563b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:34 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Volume 0bfbb885-2401-41b1-8326-6460f9219a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bfbb885-2401-41b1-8326-6460f9219a35', 'volume_size': 1} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:34 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f" returned: 0 in 0.328s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.543s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1210536880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f77e35-7751-4cc5-a834-4657e6b30e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:34Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Creating volume 01f77e35-7751-4cc5-a834-4657e6b30e26 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:34 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93d858c-d009-48ca-9d3b-6993f199c917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f401455-2af5-4649-8ccd-7e6a98cb803f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:34 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 1073741824 Nov 04 19:11:34 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7dc2417-c7b2-413f-9d2a-0c45b6f09b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Flow 'volume_create_manager' (2879b1ed-66af-4729-aa98-fd03ae1e644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4ac20f-6f44-4f10-83a8-49d2e2044d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:34 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Volume volume-8f401455-2af5-4649-8ccd-7e6a98cb803f (8f401455-2af5-4649-8ccd-7e6a98cb803f): created successfully Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7dc2417-c7b2-413f-9d2a-0c45b6f09b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Flow 'volume_create_manager' (3f776b0a-252a-4e3d-92b6-fa7eb4509aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4ac20f-6f44-4f10-83a8-49d2e2044d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-866563342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73458476-2e26-4dfa-9be2-673ecf7dc881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76a1939074d46cdb72e0a8c6c1b305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:34Z,use_quota=True,user_id='5095a41f134f4e8a86db4afc11fb6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e00b7f7-7940-46f6-916c-2501fa27426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e00b7f7-7940-46f6-916c-2501fa27426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e936679-ca90-4377-ac34-56a4f81b5e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e936679-ca90-4377-ac34-56a4f81b5e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73458476-2e26-4dfa-9be2-673ecf7dc881', 'volume_name': 'volume-73458476-2e26-4dfa-9be2-673ecf7dc881', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd06a08-834b-4aed-b12a-786729ac8b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd06a08-834b-4aed-b12a-786729ac8b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ceb271-7960-49a9-a181-ecca4f8f3dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:34 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Volume 73458476-2e26-4dfa-9be2-673ecf7dc881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73458476-2e26-4dfa-9be2-673ecf7dc881', 'volume_size': 1} Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:34 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9174910b-d538-486a-94d1-55877a1f9969 tempest-CreateVolumesFromImageTest-1937355683 None] Created volume successfully. Nov 04 19:11:34 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Flow 'volume_create_manager' (d017fdae-7efb-43af-bbde-e59be8dfae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09608412-b900-473b-a7aa-6d42deca95eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09608412-b900-473b-a7aa-6d42deca95eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-769905829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0137b5-73ea-4461-8a80-ced777d060d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76a1939074d46cdb72e0a8c6c1b305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:35Z,use_quota=True,user_id='5095a41f134f4e8a86db4afc11fb6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77503a3c-1ba2-495c-ac0e-5cc914e66fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77503a3c-1ba2-495c-ac0e-5cc914e66fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a54b05-371b-4b96-88d3-0737abced576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a54b05-371b-4b96-88d3-0737abced576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0137b5-73ea-4461-8a80-ced777d060d8', 'volume_name': 'volume-8d0137b5-73ea-4461-8a80-ced777d060d8', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5a2275-2f4b-4e4e-ae13-1b145df0e09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5a2275-2f4b-4e4e-ae13-1b145df0e09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b09a0140-7688-4fcf-9aa7-bbcf49d69ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:35 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Volume 8d0137b5-73ea-4461-8a80-ced777d060d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0137b5-73ea-4461-8a80-ced777d060d8', 'volume_size': 1} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:35 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 1073741824" returned: 0 in 0.714s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:35 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 Nov 04 19:11:35 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:35 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Flow 'volume_create_manager' (1e799db2-a8aa-4c9a-a5c5-efb3716b8ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ad82bd-1855-4566-9eb4-8313ab535b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26" returned: 0 in 0.404s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.409s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-844879832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfbb885-2401-41b1-8326-6460f9219a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76a1939074d46cdb72e0a8c6c1b305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:34Z,use_quota=True,user_id='5095a41f134f4e8a86db4afc11fb6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Creating volume 0bfbb885-2401-41b1-8326-6460f9219a35 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:35 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ad82bd-1855-4566-9eb4-8313ab535b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-64259965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b0f092-80df-41a7-aff1-3cff1b4c3cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76a1939074d46cdb72e0a8c6c1b305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:36Z,use_quota=True,user_id='5095a41f134f4e8a86db4afc11fb6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:35 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35 1073741824 Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216e4852-706f-406f-8240-16bb309e37e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:35 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216e4852-706f-406f-8240-16bb309e37e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73de28d9-a843-4e44-ac27-96dd4d5171df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73de28d9-a843-4e44-ac27-96dd4d5171df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b0f092-80df-41a7-aff1-3cff1b4c3cd2', 'volume_name': 'volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f452f888-3b55-4407-b61d-b14d763b4f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f452f888-3b55-4407-b61d-b14d763b4f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b894a56b-2551-4bee-ace4-86d989db5a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:35 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Volume 19b0f092-80df-41a7-aff1-3cff1b4c3cd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2', 'volume_size': 1} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1820feb-3d7f-46a7-96e1-7e7c426bbb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f77e35-7751-4cc5-a834-4657e6b30e26', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e796e421-0f00-4567-99bb-3114a4cc938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:35 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume volume-01f77e35-7751-4cc5-a834-4657e6b30e26 (01f77e35-7751-4cc5-a834-4657e6b30e26): created successfully Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e796e421-0f00-4567-99bb-3114a4cc938f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (09804990-20d4-4ce7-a504-ef2977860d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:35 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6482a607-4fb9-4bcb-9a24-34143a03f62d tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created volume successfully. Nov 04 19:11:36 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35 1073741824" returned: 0 in 0.546s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:36 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35 Nov 04 19:11:36 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:36 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35" returned: 0 in 0.316s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.948s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-866563342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73458476-2e26-4dfa-9be2-673ecf7dc881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76a1939074d46cdb72e0a8c6c1b305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:34Z,use_quota=True,user_id='5095a41f134f4e8a86db4afc11fb6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Creating volume 73458476-2e26-4dfa-9be2-673ecf7dc881 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:36 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:36 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881 1073741824 Nov 04 19:11:36 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5072b3-4b62-4848-81de-f4969dd5563b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bfbb885-2401-41b1-8326-6460f9219a35', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3faf0c-8ec6-4b87-b4b5-01581c032112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:36 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Volume volume-0bfbb885-2401-41b1-8326-6460f9219a35 (0bfbb885-2401-41b1-8326-6460f9219a35): created successfully Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3faf0c-8ec6-4b87-b4b5-01581c032112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Flow 'volume_create_manager' (45cf3b20-fcba-4b7e-b8ba-4cbcaaf1dfd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Flow 'volume_create_manager' (77b35e2a-0239-4ae7-b91c-d3fede41291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad35e430-e781-4e02-957c-3e19eaf314c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f6536976-fd75-4ce3-829b-664efc25e5d8 tempest-CreateVolumesFromImageTest-1937355683 None] Created volume successfully. Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad35e430-e781-4e02-957c-3e19eaf314c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8b1709-a49f-41d3-80df-b93e5f501167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5bf95f49b64cb295f7d5326125b198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:37Z,use_quota=True,user_id='949d47c9700141858475ddc2cd14b451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99eddaac-2b14-47e6-9df8-de657c90a31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99eddaac-2b14-47e6-9df8-de657c90a31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49e521a-338a-451a-ba48-8c1671521515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:36 devstack cinder-volume[87364]: DEBUG cinder.image.glance [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Creating Keystone auth plugin from conf {{(pid=87364) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:37 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881 1073741824" returned: 0 in 0.612s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49e521a-338a-451a-ba48-8c1671521515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6f8b1709-a49f-41d3-80df-b93e5f501167', 'volume_name': 'volume-6f8b1709-a49f-41d3-80df-b93e5f501167', 'volume_size': 1, 'image_id': '00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '088a64a26b7a988989a81dc358f7ae06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e5bf95f49b64cb295f7d5326125b198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0051fb0025223b1ffb3f5602c8046c1b44edac5821ade504c348b9a43250832eec24c714ce50306aa8f3c8c224fa8b86ec3594c972e61d47b5f45016a8e114ba', 'id': '00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'created_at': datetime.datetime(2026, 11, 4, 18, 11, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 11, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8/file', 'properties': {}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c232f251-b4f1-4e27-a3e0-fc7424bf0c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c232f251-b4f1-4e27-a3e0-fc7424bf0c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffd87f4-1de3-4bf1-a116-e6876212fbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:37 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Volume 6f8b1709-a49f-41d3-80df-b93e5f501167: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6f8b1709-a49f-41d3-80df-b93e5f501167', 'volume_size': 1, 'image_id': '00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '088a64a26b7a988989a81dc358f7ae06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e5bf95f49b64cb295f7d5326125b198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0051fb0025223b1ffb3f5602c8046c1b44edac5821ade504c348b9a43250832eec24c714ce50306aa8f3c8c224fa8b86ec3594c972e61d47b5f45016a8e114ba', 'id': '00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'created_at': datetime.datetime(2026, 11, 4, 18, 11, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 11, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8/file', 'properties': {}}, 'image_service': } Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Trying to clone 6f8b1709-a49f-41d3-80df-b93e5f501167 from image 00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'metadata': {}}]). {{(pid=87364) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:37 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881 Nov 04 19:11:37 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:11:37 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc5a98a-7719-44ed-a810-99febf68fd68]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:37 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD Nov 04 19:11:37 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:37 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881" returned: 0 in 0.282s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.493s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-769905829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0137b5-73ea-4461-8a80-ced777d060d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76a1939074d46cdb72e0a8c6c1b305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:35Z,use_quota=True,user_id='5095a41f134f4e8a86db4afc11fb6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Creating volume 8d0137b5-73ea-4461-8a80-ced777d060d8 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:37 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ceb271-7960-49a9-a181-ecca4f8f3dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73458476-2e26-4dfa-9be2-673ecf7dc881', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46009965-56b5-4b80-ade1-9391cf5d9c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:37 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8 1073741824 Nov 04 19:11:37 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:37 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Volume volume-73458476-2e26-4dfa-9be2-673ecf7dc881 (73458476-2e26-4dfa-9be2-673ecf7dc881): created successfully Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46009965-56b5-4b80-ade1-9391cf5d9c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Flow 'volume_create_manager' (2879b1ed-66af-4729-aa98-fd03ae1e644f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-63066fb5-77fc-4ba8-bf6a-a42fea870cc7 tempest-CreateVolumesFromImageTest-1937355683 None] Created volume successfully. Nov 04 19:11:37 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:37 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD Nov 04 19:11:37 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:38 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8 1073741824" returned: 0 in 0.561s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:38 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD" returned: 1 in 0.393s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Temporary image 00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8 is fetched for user 949d47c9700141858475ddc2cd14b451. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:11:38 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8 Nov 04 19:11:38 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Flow 'volume_create_manager' (37b3fcc9-12b7-42b9-94cd-c50206b1bf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19da4a05-45e0-4396-98a2-5c325f3d114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4fe623-3cee-485d-adf9-a82bc0149f53]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19da4a05-45e0-4396-98a2-5c325f3d114e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a454f645-a5b3-4651-9b9f-f87a4bdfd711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3ff2bfa2cc41488d0d59d78ff05326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:38Z,use_quota=True,user_id='eeef58a0729e48a380568610056bd67a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a85d339-23ca-48ac-9270-02254197e59b),volume_type_id=6a85d339-23ca-48ac-9270-02254197e59b)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260ff141-2373-4438-98ee-0afca9ba39e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260ff141-2373-4438-98ee-0afca9ba39e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5893b83-516c-44fa-9ffb-ca47c19e6d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.image.glance [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Creating Keystone auth plugin from conf {{(pid=87364) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 04 19:11:38 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD Nov 04 19:11:38 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:38 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.736s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-64259965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b0f092-80df-41a7-aff1-3cff1b4c3cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d76a1939074d46cdb72e0a8c6c1b305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:36Z,use_quota=True,user_id='5095a41f134f4e8a86db4afc11fb6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Creating volume 19b0f092-80df-41a7-aff1-3cff1b4c3cd2 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:38 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:38 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2 1073741824 Nov 04 19:11:38 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b09a0140-7688-4fcf-9aa7-bbcf49d69ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0137b5-73ea-4461-8a80-ced777d060d8', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2d2462-9bdb-40b2-ba3b-e73a8fb4f410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:38 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Volume volume-8d0137b5-73ea-4461-8a80-ced777d060d8 (8d0137b5-73ea-4461-8a80-ced777d060d8): created successfully Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2d2462-9bdb-40b2-ba3b-e73a8fb4f410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Flow 'volume_create_manager' (d017fdae-7efb-43af-bbde-e59be8dfae22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:38 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2e15f199-1027-43cf-8e56-0645a1cd9bed tempest-CreateVolumesFromImageTest-1937355683 None] Created volume successfully. Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5893b83-516c-44fa-9ffb-ca47c19e6d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a454f645-a5b3-4651-9b9f-f87a4bdfd711', 'volume_name': 'volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711', 'volume_size': 1, 'image_id': 'a0ae9896-d34b-4072-8e15-70447d4954ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0ae9896-d34b-4072-8e15-70447d4954ae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab7e05813157aea8030bac446a231905', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd3ff2bfa2cc41488d0d59d78ff05326', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c010e4797894c3282981374f63d7780a0f541c7dd478340bd1eab332c3b2d3d2c52be1bd0464774fcb41217ddba99f773b83fd56ca455b23050e33a6c9900826', 'id': 'a0ae9896-d34b-4072-8e15-70447d4954ae', 'created_at': datetime.datetime(2026, 11, 4, 18, 11, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 11, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0ae9896-d34b-4072-8e15-70447d4954ae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b134e89-7edb-4c39-ac5e-f4d24d4be9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b134e89-7edb-4c39-ac5e-f4d24d4be9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5876fbc7-1bd2-4f08-b40c-c65496ecebd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:38 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Volume a454f645-a5b3-4651-9b9f-f87a4bdfd711: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711', 'volume_size': 1, 'image_id': 'a0ae9896-d34b-4072-8e15-70447d4954ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0ae9896-d34b-4072-8e15-70447d4954ae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab7e05813157aea8030bac446a231905', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd3ff2bfa2cc41488d0d59d78ff05326', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c010e4797894c3282981374f63d7780a0f541c7dd478340bd1eab332c3b2d3d2c52be1bd0464774fcb41217ddba99f773b83fd56ca455b23050e33a6c9900826', 'id': 'a0ae9896-d34b-4072-8e15-70447d4954ae', 'created_at': datetime.datetime(2026, 11, 4, 18, 11, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 11, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0ae9896-d34b-4072-8e15-70447d4954ae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Trying to clone a454f645-a5b3-4651-9b9f-f87a4bdfd711 from image a0ae9896-d34b-4072-8e15-70447d4954ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/a0ae9896-d34b-4072-8e15-70447d4954ae', 'metadata': {}}]). {{(pid=87364) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 04 19:11:38 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 04 19:11:38 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Image download 0.00 MB at 0.00 MB/s Nov 04 19:11:38 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD Nov 04 19:11:38 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[564e8f89-c34c-4308-9374-603815c253f9]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:39 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD Nov 04 19:11:39 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:39 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2 1073741824" returned: 0 in 0.530s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:39 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2 Nov 04 19:11:39 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:39 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD" returned: 1 in 0.403s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:39 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:39 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2" returned: 0 in 0.253s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.186s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Creating offline snapshot f57d5b4d-4d2d-439a-9b64-8e2300478951 of volume 01f77e35-7751-4cc5-a834-4657e6b30e26 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:11:39 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b894a56b-2551-4bee-ace4-86d989db5a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:39 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd500375-955e-4a72-af21-57c30bc78373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a353ee-6477-4b55-a486-b63d798a7bde]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:39 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Volume volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2 (19b0f092-80df-41a7-aff1-3cff1b4c3cd2): created successfully Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd500375-955e-4a72-af21-57c30bc78373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Flow 'volume_create_manager' (1e799db2-a8aa-4c9a-a5c5-efb3716b8ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:39 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e96f2868-81f7-4d0a-8008-686e43060d73 tempest-CreateVolumesFromImageTest-1937355683 None] Created volume successfully. Nov 04 19:11:39 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 Nov 04 19:11:39 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:39 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Temporary image a0ae9896-d34b-4072-8e15-70447d4954ae is fetched for user eeef58a0729e48a380568610056bd67a. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7813c3-d785-4676-8828-4b3bc03843ab]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:39 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26" returned: 0 in 0.391s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:39 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD Nov 04 19:11:39 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:39 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 1G Nov 04 19:11:39 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:40 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "cinder-19b0f092-80df-41a7-aff1-3cff1b4c3cd2-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-19b0f092-80df-41a7-aff1-3cff1b4c3cd2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:40 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD Nov 04 19:11:40 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:40 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 1G" returned: 0 in 0.482s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f77e35-7751-4cc5-a834-4657e6b30e26 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:40 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f77e35-7751-4cc5-a834-4657e6b30e26 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 Nov 04 19:11:40 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "cinder-quobyte-19b0f092-80df-41a7-aff1-3cff1b4c3cd2" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-quobyte-19b0f092-80df-41a7-aff1-3cff1b4c3cd2" acquired by "delete_volume" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[11863552-bd7d-4428-84ef-5cd1caba1cce]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:40 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:40 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2 Nov 04 19:11:40 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:40 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f77e35-7751-4cc5-a834-4657e6b30e26 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951" returned: 0 in 0.347s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:40 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 is being set with open permissions: ugo+rw Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:40 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 Nov 04 19:11:40 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:40 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2" returned: 0 in 0.380s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:40 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2 Nov 04 19:11:40 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:40 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951" returned: 0 in 0.262s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:40 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.info Nov 04 19:11:40 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:41 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-19b0f092-80df-41a7-aff1-3cff1b4c3cd2" returned: 0 in 0.271s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-quobyte-19b0f092-80df-41a7-aff1-3cff1b4c3cd2" released by "delete_volume" :: held 0.702s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Created reservations ['c54c8be2-d525-45e5-b1f0-474daae64796', 'f8227712-a780-4fec-9c75-3afd16777ffb', '858890cf-8b5d-4965-b50a-395c9bbea44e', 'acc29da3-59b4-40af-b9db-d8d4076e696a'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:41 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.info" returned: 0 in 0.277s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:41 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.info is being set with open permissions: ugo+rw Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:41 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:41 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:41 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.info Nov 04 19:11:41 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "cinder-8d0137b5-73ea-4461-8a80-ced777d060d8-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-8d0137b5-73ea-4461-8a80-ced777d060d8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "cinder-quobyte-8d0137b5-73ea-4461-8a80-ced777d060d8" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-quobyte-8d0137b5-73ea-4461-8a80-ced777d060d8" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:41 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Deleted volume successfully. Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a8376f-b361-4e3d-a77f-a45c2c01e315]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-34b1fec4-261f-4a30-9074-c864045e2525 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-19b0f092-80df-41a7-aff1-3cff1b4c3cd2-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:41 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.info" returned: 0 in 0.308s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.366s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8b1709-a49f-41d3-80df-b93e5f501167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5bf95f49b64cb295f7d5326125b198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:37Z,use_quota=True,user_id='949d47c9700141858475ddc2cd14b451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Creating volume 6f8b1709-a49f-41d3-80df-b93e5f501167 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:41 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:41 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 1073741824 Nov 04 19:11:41 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-e99bef38-e094-4ad0-ac66-b784c5f9fbd6 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Create snapshot completed successfully Nov 04 19:11:41 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8 Nov 04 19:11:41 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:41 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8" returned: 0 in 0.387s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:41 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8 Nov 04 19:11:41 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:41 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 1073741824" returned: 0 in 0.442s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:42 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 Nov 04 19:11:42 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:42 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8d0137b5-73ea-4461-8a80-ced777d060d8" returned: 0 in 0.266s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-quobyte-8d0137b5-73ea-4461-8a80-ced777d060d8" released by "delete_volume" :: held 0.733s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Created reservations ['48a0890e-3cb5-4e3f-bf21-3d8c57f9be62', '5feb72b0-ce2e-40eb-b1bc-d522555b432c', '93db95a0-9ba5-488d-9bbe-ec2628b2e53a', '295efb70-30e2-43a2-99f7-011e7ea0c958'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:42 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167" returned: 0 in 0.289s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:42 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:42 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.899s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a454f645-a5b3-4651-9b9f-f87a4bdfd711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3ff2bfa2cc41488d0d59d78ff05326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:38Z,use_quota=True,user_id='eeef58a0729e48a380568610056bd67a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a85d339-23ca-48ac-9270-02254197e59b),volume_type_id=6a85d339-23ca-48ac-9270-02254197e59b)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Creating volume a454f645-a5b3-4651-9b9f-f87a4bdfd711 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:42 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:42 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 1073741824 Nov 04 19:11:42 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Attempting download of 00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'metadata': {}}])) to volume 6f8b1709-a49f-41d3-80df-b93e5f501167. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef907d4d-06c1-47a4-8225-2b1ebf0b8496]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_cjbkeuhb {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:42 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_cjbkeuhb Nov 04 19:11:42 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:42 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "cinder-73458476-2e26-4dfa-9be2-673ecf7dc881-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.358s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Deleted volume successfully. Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-73458476-2e26-4dfa-9be2-673ecf7dc881-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8a9f9e74-aead-46be-8234-4b2fff43172a tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-8d0137b5-73ea-4461-8a80-ced777d060d8-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "cinder-quobyte-73458476-2e26-4dfa-9be2-673ecf7dc881" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-quobyte-73458476-2e26-4dfa-9be2-673ecf7dc881" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bae9676-d024-4cbd-bdf5-c1f4b763ac20]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:42 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_cjbkeuhb" returned: 0 in 0.450s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_cjbkeuhb {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:42 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 1073741824" returned: 0 in 0.632s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:42 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881 Nov 04 19:11:42 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:43 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_cjbkeuhb Nov 04 19:11:43 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:43 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 Nov 04 19:11:43 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (1b3862cc-555c-48d2-b68a-bcc4e7f028dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380d17b2-b7b0-4c31-9bb7-e94a99e9f58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:43 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_cjbkeuhb" returned: 1 in 0.494s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_cjbkeuhb' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe00b96-c313-4bda-93e0-887a1927d7bc]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380d17b2-b7b0-4c31-9bb7-e94a99e9f58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2087832504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1810d3f-e413-4ead-9256-c03a15276914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:43Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:43 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f72d7a0-2107-4dc3-b058-f6b818ab9536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f72d7a0-2107-4dc3-b058-f6b818ab9536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7b5425-9bcf-4454-b5ae-54297f81672b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7b5425-9bcf-4454-b5ae-54297f81672b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1810d3f-e413-4ead-9256-c03a15276914', 'volume_name': 'volume-a1810d3f-e413-4ead-9256-c03a15276914', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa10e611-ae9a-4b59-94c4-269de2235cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa10e611-ae9a-4b59-94c4-269de2235cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734b0cd0-712b-4a98-ad75-bb34d20e780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:43 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume a1810d3f-e413-4ead-9256-c03a15276914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1810d3f-e413-4ead-9256-c03a15276914', 'volume_size': 1} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881" returned: 0 in 0.593s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:43 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711" returned: 0 in 0.450s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2087832504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1810d3f-e413-4ead-9256-c03a15276914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:43Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Creating volume a1810d3f-e413-4ead-9256-c03a15276914 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:43 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881 Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:43 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:43 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:43 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914 1073741824 Nov 04 19:11:43 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Attempting download of a0ae9896-d34b-4072-8e15-70447d4954ae ((None, [{'url': 'file:///opt/stack/data/glance/images/a0ae9896-d34b-4072-8e15-70447d4954ae', 'metadata': {}}])) to volume a454f645-a5b3-4651-9b9f-f87a4bdfd711. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 04 19:11:43 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD Nov 04 19:11:43 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d645ee-164a-48d0-89af-8809c9b101ec]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0ae9896-d34b-4072-8e15-70447d4954ae_6llaj9jp {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:43 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-73458476-2e26-4dfa-9be2-673ecf7dc881" returned: 0 in 0.388s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-quobyte-73458476-2e26-4dfa-9be2-673ecf7dc881" released by "delete_volume" :: held 1.052s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:43 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0ae9896-d34b-4072-8e15-70447d4954ae_6llaj9jp Nov 04 19:11:43 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Created reservations ['a43e0c6d-c679-4424-bee5-ee3f92fc5acf', '3a40f26e-b670-4385-b713-b62444c58dd4', '96024ac5-48ac-4eab-80e0-5f722b03eb73', '9fefb990-6901-4c49-a4ff-90351aad8e5c'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (655af72a-2397-46f8-a265-e14cd30a33bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21f3d02-c24e-4f93-8d34-ed58c526be25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21f3d02-c24e-4f93-8d34-ed58c526be25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-680603816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4503f117-1fa1-4dae-b58e-61af0cbf6032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:44Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2912964-eb0d-4f59-8615-3c7e2f341d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2912964-eb0d-4f59-8615-3c7e2f341d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975754de-0bdd-4ca5-8fef-554b79e524e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975754de-0bdd-4ca5-8fef-554b79e524e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4503f117-1fa1-4dae-b58e-61af0cbf6032', 'volume_name': 'volume-4503f117-1fa1-4dae-b58e-61af0cbf6032', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3dca13-b1ff-4835-9298-ce975acf66e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3dca13-b1ff-4835-9298-ce975acf66e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55eb4dd-1375-4906-a078-f7881ea2ea8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume 4503f117-1fa1-4dae-b58e-61af0cbf6032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4503f117-1fa1-4dae-b58e-61af0cbf6032', 'volume_size': 1} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:44 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD" returned: 0 in 0.707s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:44 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914 1073741824" returned: 0 in 0.779s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:44 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:44 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:44 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD Nov 04 19:11:44 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:44 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a0ae9896-d34b-4072-8e15-70447d4954ae_6llaj9jp" returned: 0 in 0.652s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0ae9896-d34b-4072-8e15-70447d4954ae_6llaj9jp {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:44 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914 Nov 04 19:11:44 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:44 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:44 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0ae9896-d34b-4072-8e15-70447d4954ae_6llaj9jp Nov 04 19:11:44 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD" returned: 1 in 0.504s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] 00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8 was raw, converting to qcow2 {{(pid=87364) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:44 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:44 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (6fd63b35-4543-4305-b0dd-15020825ad51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9531bfd-0f9b-41cf-9658-b0b0a9e2f6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.588s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9531bfd-0f9b-41cf-9658-b0b0a9e2f6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-591345577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e27b742-ccdb-4cd5-940a-ad1a3859ad00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:45Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fe977b-77c7-479e-a160-65dee46afc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fe977b-77c7-479e-a160-65dee46afc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d252fc24-4f62-4143-8fb4-a16a197fe19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d252fc24-4f62-4143-8fb4-a16a197fe19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e27b742-ccdb-4cd5-940a-ad1a3859ad00', 'volume_name': 'volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accd2c36-78a1-4fed-b6ce-8ec87a4bd584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accd2c36-78a1-4fed-b6ce-8ec87a4bd584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443eb527-b672-4f75-93c2-d5227b2f3785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:44 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume 0e27b742-ccdb-4cd5-940a-ad1a3859ad00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00', 'volume_size': 1} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:44 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Deleted volume successfully. Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0ae9896-d34b-4072-8e15-70447d4954ae_6llaj9jp" returned: 1 in 0.599s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a0ae9896-d34b-4072-8e15-70447d4954ae_6llaj9jp' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[51344b3d-ecc6-499f-b674-c51e2e350be1]: (4, 'raw') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:44 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914" returned: 0 in 0.587s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-680603816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4503f117-1fa1-4dae-b58e-61af0cbf6032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:44Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Creating volume 4503f117-1fa1-4dae-b58e-61af0cbf6032 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:44 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734b0cd0-712b-4a98-ad75-bb34d20e780f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1810d3f-e413-4ead-9256-c03a15276914', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:45 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032 1073741824 Nov 04 19:11:45 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc085f7-cde4-4785-a646-dfd6bbf8d1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8bce624e-8527-4ad5-9eed-f30b6b745f36 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-73458476-2e26-4dfa-9be2-673ecf7dc881-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:45 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume volume-a1810d3f-e413-4ead-9256-c03a15276914 (a1810d3f-e413-4ead-9256-c03a15276914): created successfully Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc085f7-cde4-4785-a646-dfd6bbf8d1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (1b3862cc-555c-48d2-b68a-bcc4e7f028dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-427073a1-d487-4dc6-83fc-bda98920e72c tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created volume successfully. Nov 04 19:11:45 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD Nov 04 19:11:45 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "cinder-0bfbb885-2401-41b1-8326-6460f9219a35-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-0bfbb885-2401-41b1-8326-6460f9219a35-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "cinder-quobyte-0bfbb885-2401-41b1-8326-6460f9219a35" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (2d0ed609-fc95-40e1-abc4-22a566e156d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0f52ad-d522-4cd5-aa87-acc07243b3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-quobyte-0bfbb885-2401-41b1-8326-6460f9219a35" acquired by "delete_volume" :: waited 0.109s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0f52ad-d522-4cd5-aa87-acc07243b3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-460201943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd20cef-e714-47bd-abd0-1accc18cda56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:45Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7669b30-ac2e-4183-920c-c8b9c40f36df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7669b30-ac2e-4183-920c-c8b9c40f36df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329cb19e-58cc-4302-8b34-c3537a70745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329cb19e-58cc-4302-8b34-c3537a70745d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd20cef-e714-47bd-abd0-1accc18cda56', 'volume_name': 'volume-4cd20cef-e714-47bd-abd0-1accc18cda56', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:45 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890b94ab-2c93-4e47-8c6b-3286690bf436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890b94ab-2c93-4e47-8c6b-3286690bf436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433cf967-433a-4a73-9065-a6d3e11feb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:45 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume 4cd20cef-e714-47bd-abd0-1accc18cda56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd20cef-e714-47bd-abd0-1accc18cda56', 'volume_size': 1} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[337ab7ea-e09e-4f0d-8b61-33a733bc8f4c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167" returned: 0 in 0.913s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8_0v7pnky_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:11:45 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:45 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD" returned: 0 in 0.626s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:45 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 1G Nov 04 19:11:45 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:45 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35 Nov 04 19:11:45 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:45 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD Nov 04 19:11:45 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:45 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (ac35da31-852d-41ce-baf2-9ba48bfaf6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004cf51e-b079-4b93-a42d-de473fe4ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032 1073741824" returned: 0 in 0.954s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004cf51e-b079-4b93-a42d-de473fe4ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989209454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0116a7-8717-4ac7-8909-0778b1a35d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:46Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dcabfec-9caa-4a7e-904e-21f64d98a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dcabfec-9caa-4a7e-904e-21f64d98a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681aebc9-a8f9-4ce5-8f3e-e2aa9b09d0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681aebc9-a8f9-4ce5-8f3e-e2aa9b09d0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0116a7-8717-4ac7-8909-0778b1a35d1f', 'volume_name': 'volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0046a0-ee4f-434f-8bd5-1947595d07f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:45 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0046a0-ee4f-434f-8bd5-1947595d07f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287db1b2-9be2-49c2-88d5-d0ed6f1e939d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:46 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume 2f0116a7-8717-4ac7-8909-0778b1a35d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f', 'volume_size': 1} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:46 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 1G" returned: 0 in 0.514s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Downloaded image 00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'metadata': {}}])) to volume 6f8b1709-a49f-41d3-80df-b93e5f501167 successfully. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:11:46 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032 Nov 04 19:11:46 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Temporary image 00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8 for user 949d47c9700141858475ddc2cd14b451 is deleted. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Marking volume 6f8b1709-a49f-41d3-80df-b93e5f501167 as bootable. {{(pid=87364) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Copying metadata from image 00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8 to 6f8b1709-a49f-41d3-80df-b93e5f501167. {{(pid=87364) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Creating volume glance metadata for volume 6f8b1709-a49f-41d3-80df-b93e5f501167 backed by image 00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8 with: {'image_id': '00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '088a64a26b7a988989a81dc358f7ae06', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87364) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:11:46 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD" returned: 1 in 0.537s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] a0ae9896-d34b-4072-8e15-70447d4954ae was raw, converting to qcow2 {{(pid=87364) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:46 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35" returned: 0 in 0.613s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:46 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 Nov 04 19:11:46 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:46 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35 Nov 04 19:11:46 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffd87f4-1de3-4bf1-a116-e6876212fbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f8b1709-a49f-41d3-80df-b93e5f501167', 'volume_size': 1, 'image_id': '00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '088a64a26b7a988989a81dc358f7ae06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e5bf95f49b64cb295f7d5326125b198', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0051fb0025223b1ffb3f5602c8046c1b44edac5821ade504c348b9a43250832eec24c714ce50306aa8f3c8c224fa8b86ec3594c972e61d47b5f45016a8e114ba', 'id': '00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8', 'created_at': datetime.datetime(2026, 11, 4, 18, 11, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 11, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00e6f81b-e3ca-4fd2-8f74-ed88e8faf1f8/file', 'properties': {}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56156194-979b-407c-957a-4e114cc7f7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:46 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Volume volume-6f8b1709-a49f-41d3-80df-b93e5f501167 (6f8b1709-a49f-41d3-80df-b93e5f501167): created successfully Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56156194-979b-407c-957a-4e114cc7f7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Flow 'volume_create_manager' (77b35e2a-0239-4ae7-b91c-d3fede41291b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:46 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-34fc692f-7ae2-44c8-9837-cc47eb8448c9 tempest-VolumeImageDependencyTests-2086523562 None] Created volume successfully. Nov 04 19:11:46 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032" returned: 0 in 0.295s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-591345577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e27b742-ccdb-4cd5-940a-ad1a3859ad00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:45Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Creating volume 0e27b742-ccdb-4cd5-940a-ad1a3859ad00 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:46 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55eb4dd-1375-4906-a078-f7881ea2ea8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4503f117-1fa1-4dae-b58e-61af0cbf6032', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:46 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00 1073741824 Nov 04 19:11:46 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb6abc7-9bb4-46d2-842d-47f002da4329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:46 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume volume-4503f117-1fa1-4dae-b58e-61af0cbf6032 (4503f117-1fa1-4dae-b58e-61af0cbf6032): created successfully Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb6abc7-9bb4-46d2-842d-47f002da4329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (655af72a-2397-46f8-a265-e14cd30a33bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:46 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c59d7f84-60b3-4480-a769-0fb988756653 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created volume successfully. Nov 04 19:11:46 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0bfbb885-2401-41b1-8326-6460f9219a35" returned: 0 in 0.346s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-quobyte-0bfbb885-2401-41b1-8326-6460f9219a35" released by "delete_volume" :: held 1.113s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Created reservations ['e513dcd5-35cd-420a-ab7e-e2eac39b9d66', 'ddc7f636-a356-4a90-9344-8c273db5c770', 'a5198c71-7ef4-4a02-bbc7-f6a489e3418a', '22b31b82-7245-4894-8ec5-7b672e2fccf8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Acquiring lock "cinder-6f8b1709-a49f-41d3-80df-b93e5f501167-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:46 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:46 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:46 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711" returned: 0 in 0.637s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a0ae9896-d34b-4072-8e15-70447d4954ae_ji9ivxetdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:11:46 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Converted 0.00 MB image at 0.00 MB/s Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Lock "cinder-6f8b1709-a49f-41d3-80df-b93e5f501167-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:46 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 1G Nov 04 19:11:46 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Acquiring lock "cinder-quobyte-6f8b1709-a49f-41d3-80df-b93e5f501167" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Lock "cinder-quobyte-6f8b1709-a49f-41d3-80df-b93e5f501167" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3902867-64d1-4484-9d1c-2bfb76c4a2fc]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:46 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00 1073741824" returned: 0 in 0.597s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:46 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 Nov 04 19:11:46 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:47 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00 Nov 04 19:11:47 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:47 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.516s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:47 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Deleted volume successfully. Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c0ff60d8-8fc5-4bf4-abf4-8be920e082d6 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-0bfbb885-2401-41b1-8326-6460f9219a35-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:47 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167" returned: 0 in 0.434s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:47 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00" returned: 0 in 0.319s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-460201943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd20cef-e714-47bd-abd0-1accc18cda56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:45Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:47 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Creating volume 4cd20cef-e714-47bd-abd0-1accc18cda56 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:47 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:47 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167 Nov 04 19:11:47 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 1G" returned: 0 in 0.598s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Downloaded image a0ae9896-d34b-4072-8e15-70447d4954ae ((None, [{'url': 'file:///opt/stack/data/glance/images/a0ae9896-d34b-4072-8e15-70447d4954ae', 'metadata': {}}])) to volume a454f645-a5b3-4651-9b9f-f87a4bdfd711 successfully. {{(pid=87364) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Temporary image a0ae9896-d34b-4072-8e15-70447d4954ae for user eeef58a0729e48a380568610056bd67a is deleted. {{(pid=87364) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.volume_utils [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Marking volume a454f645-a5b3-4651-9b9f-f87a4bdfd711 as bootable. {{(pid=87364) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 04 19:11:47 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56 1073741824 Nov 04 19:11:47 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443eb527-b672-4f75-93c2-d5227b2f3785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9003fcd-82f3-4f64-a9a6-d001208dc146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Copying metadata from image a0ae9896-d34b-4072-8e15-70447d4954ae to a454f645-a5b3-4651-9b9f-f87a4bdfd711. {{(pid=87364) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Creating volume glance metadata for volume a454f645-a5b3-4651-9b9f-f87a4bdfd711 backed by image a0ae9896-d34b-4072-8e15-70447d4954ae with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a0ae9896-d34b-4072-8e15-70447d4954ae', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ab7e05813157aea8030bac446a231905', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87364) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 04 19:11:47 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00 (0e27b742-ccdb-4cd5-940a-ad1a3859ad00): created successfully Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9003fcd-82f3-4f64-a9a6-d001208dc146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (6fd63b35-4543-4305-b0dd-15020825ad51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:47 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6462e28f-a960-4b28-a65e-cafe263a771e tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created volume successfully. Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5876fbc7-1bd2-4f08-b40c-c65496ecebd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711', 'volume_size': 1, 'image_id': 'a0ae9896-d34b-4072-8e15-70447d4954ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a0ae9896-d34b-4072-8e15-70447d4954ae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab7e05813157aea8030bac446a231905', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd3ff2bfa2cc41488d0d59d78ff05326', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c010e4797894c3282981374f63d7780a0f541c7dd478340bd1eab332c3b2d3d2c52be1bd0464774fcb41217ddba99f773b83fd56ca455b23050e33a6c9900826', 'id': 'a0ae9896-d34b-4072-8e15-70447d4954ae', 'created_at': datetime.datetime(2026, 11, 4, 18, 11, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 18, 11, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a0ae9896-d34b-4072-8e15-70447d4954ae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaef778e-bea7-42a4-a565-b38d0d356a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:47 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Volume volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 (a454f645-a5b3-4651-9b9f-f87a4bdfd711): created successfully Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaef778e-bea7-42a4-a565-b38d0d356a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Flow 'volume_create_manager' (37b3fcc9-12b7-42b9-94cd-c50206b1bf3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "cinder-8f401455-2af5-4649-8ccd-7e6a98cb803f-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:47 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-65a4a61c-c7a5-4758-9061-7f74dc25d9cb tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Created volume successfully. Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-8f401455-2af5-4649-8ccd-7e6a98cb803f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "cinder-quobyte-8f401455-2af5-4649-8ccd-7e6a98cb803f" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:47 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f8b1709-a49f-41d3-80df-b93e5f501167" returned: 0 in 0.336s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Lock "cinder-quobyte-6f8b1709-a49f-41d3-80df-b93e5f501167" released by "delete_volume" :: held 0.821s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-quobyte-8f401455-2af5-4649-8ccd-7e6a98cb803f" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6b8afe-097c-49ef-a779-ae2009cd0a5d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Created reservations ['f71a3269-5ba4-4f9a-8a48-5bcf354464bd', '6760c51b-7280-4aee-a4ba-d3227f26d6b6', '07fa73ce-eaeb-43cf-8e00-ccc7b44c296c', '7576195f-8420-471f-a8d4-49608091f3bb'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:47 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f Nov 04 19:11:47 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:47 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:47 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:47 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56 1073741824" returned: 0 in 0.606s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:48 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56 Nov 04 19:11:48 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:48 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.325s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:48 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Deleted volume successfully. Nov 04 19:11:48 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c8b540-7874-417f-8b61-60dbf240391c tempest-VolumeImageDependencyTests-2086523562 None] Lock "cinder-6f8b1709-a49f-41d3-80df-b93e5f501167-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f" returned: 0 in 0.508s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Acquiring lock "cinder-a454f645-a5b3-4651-9b9f-f87a4bdfd711-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:48 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f Nov 04 19:11:48 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Lock "cinder-a454f645-a5b3-4651-9b9f-f87a4bdfd711-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Acquiring lock "cinder-quobyte-a454f645-a5b3-4651-9b9f-f87a4bdfd711" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Lock "cinder-quobyte-a454f645-a5b3-4651-9b9f-f87a4bdfd711" acquired by "delete_volume" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:48 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c834faad-d050-4873-8eca-85353b992500]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56" returned: 0 in 0.444s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.453s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989209454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0116a7-8717-4ac7-8909-0778b1a35d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bf743c54df4f749cbdd3a6bd6a3499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:46Z,use_quota=True,user_id='04d91d6f55fe4372b86ed0d7715c25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Creating volume 2f0116a7-8717-4ac7-8909-0778b1a35d1f {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:48 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433cf967-433a-4a73-9065-a6d3e11feb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd20cef-e714-47bd-abd0-1accc18cda56', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd556984-f845-477b-adeb-4309ff7f18db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:48 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f 1073741824 Nov 04 19:11:48 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:48 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume volume-4cd20cef-e714-47bd-abd0-1accc18cda56 (4cd20cef-e714-47bd-abd0-1accc18cda56): created successfully Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd556984-f845-477b-adeb-4309ff7f18db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (2d0ed609-fc95-40e1-abc4-22a566e156d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:48 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c5780939-2c69-4dee-bfa2-052ea4bd3108 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created volume successfully. Nov 04 19:11:48 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 Nov 04 19:11:48 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:48 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8f401455-2af5-4649-8ccd-7e6a98cb803f" returned: 0 in 0.538s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-quobyte-8f401455-2af5-4649-8ccd-7e6a98cb803f" released by "delete_volume" :: held 1.109s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Created reservations ['7519affd-7878-45bd-a422-bf9c3c73b7c9', 'd26da6f4-9554-4116-8dc7-b1872c0e2bc6', '3967583a-8a37-42ee-a1fd-b9384d1cb364', '2eeaae22-1be8-42f4-a73b-0df8baedaf8f'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:48 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711" returned: 0 in 0.530s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:48 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:48 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:48 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711 Nov 04 19:11:48 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:49 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f 1073741824" returned: 0 in 0.756s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:49 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a454f645-a5b3-4651-9b9f-f87a4bdfd711" returned: 0 in 0.308s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:49 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.335s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Lock "cinder-quobyte-a454f645-a5b3-4651-9b9f-f87a4bdfd711" released by "delete_volume" :: held 0.920s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:49 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Deleted volume successfully. Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-96d305c5-59ac-497e-ae1a-50b4784543b2 tempest-CreateVolumesFromImageTest-1937355683 None] Lock "cinder-8f401455-2af5-4649-8ccd-7e6a98cb803f-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:49 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f Nov 04 19:11:49 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Created reservations ['518b8add-fd88-4d80-a880-1d1db11db5d6', '1d854143-0687-4d42-916d-1d95bcdc2ee1', '963e6937-0595-4d74-ba2d-df3ca91a2593', 'f3e759b9-ab43-4836-a040-5b940c1385b4'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:49 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:49 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:49 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f" returned: 0 in 0.330s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287db1b2-9be2-49c2-88d5-d0ed6f1e939d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bbfda6-1ff7-427c-8650-7628e540ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:49 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Volume volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f (2f0116a7-8717-4ac7-8909-0778b1a35d1f): created successfully Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bbfda6-1ff7-427c-8650-7628e540ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Flow 'volume_create_manager' (ac35da31-852d-41ce-baf2-9ba48bfaf6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:49 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-72060a7a-13f0-4993-8e3f-ca2bcc9ca2bb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created volume successfully. Nov 04 19:11:49 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.371s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:49 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Deleted volume successfully. Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed816e67-e5ab-4878-8094-f2ed33a0cf65 tempest-VolumeAndVolumeTypeFromImageTest-1284419300 None] Lock "cinder-a454f645-a5b3-4651-9b9f-f87a4bdfd711-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-2f0116a7-8717-4ac7-8909-0778b1a35d1f-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-2f0116a7-8717-4ac7-8909-0778b1a35d1f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-quobyte-2f0116a7-8717-4ac7-8909-0778b1a35d1f" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-2f0116a7-8717-4ac7-8909-0778b1a35d1f" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:50 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c82e521-3705-4acc-b294-e4c639cf4554]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:50 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f Nov 04 19:11:50 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:50 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f" returned: 0 in 0.482s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:50 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f Nov 04 19:11:50 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:50 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2f0116a7-8717-4ac7-8909-0778b1a35d1f" returned: 0 in 0.371s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-2f0116a7-8717-4ac7-8909-0778b1a35d1f" released by "delete_volume" :: held 0.910s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:51 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created reservations ['a4ab1f56-6507-4ba8-84be-78ba66ac7a4a', 'bef9457a-df4f-4fb1-a31e-28d18a7e2252', 'dbca1414-1697-48c5-b48b-49a8e1dbb704', '7d30321f-7da5-48a2-a141-2f9361c26bd7'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:51 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:51 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:51 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.318s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:51 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:51 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Deleted volume successfully. Nov 04 19:11:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed7a099e-091b-4cf3-9958-fb70ad41d5ed tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-2f0116a7-8717-4ac7-8909-0778b1a35d1f-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-4cd20cef-e714-47bd-abd0-1accc18cda56-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-4cd20cef-e714-47bd-abd0-1accc18cda56-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-quobyte-4cd20cef-e714-47bd-abd0-1accc18cda56" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:52 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-4cd20cef-e714-47bd-abd0-1accc18cda56" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:52 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c154e1db-2f6a-4f61-a5b7-192420a22ee7]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:52 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56 Nov 04 19:11:52 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:53 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56" returned: 0 in 0.597s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:53 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56 Nov 04 19:11:53 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Flow 'volume_create_manager' (2d2ef28a-cc3e-4530-9f3e-f3f5b5c4ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2591db6b-2465-4e80-927c-f0132e3d2f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2591db6b-2465-4e80-927c-f0132e3d2f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43f277c-08f4-4e5d-a042-1930718fcb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f6d5ef2314882b5957f0fcad3e1a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:53Z,use_quota=True,user_id='9d9651b30d664b09b6ed8d21306fd275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b05d4c0-7e88-4b19-9cdb-845e7d376e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b05d4c0-7e88-4b19-9cdb-845e7d376e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4ee6ff-7606-439d-a3e8-6a61db692e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4ee6ff-7606-439d-a3e8-6a61db692e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43f277c-08f4-4e5d-a042-1930718fcb50', 'volume_name': 'volume-b43f277c-08f4-4e5d-a042-1930718fcb50', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362acef8-4624-4c9c-9201-8e4138d9fad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362acef8-4624-4c9c-9201-8e4138d9fad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2fa3e2-cfb9-4f38-a021-e71fdcc60bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:53 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Volume b43f277c-08f4-4e5d-a042-1930718fcb50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43f277c-08f4-4e5d-a042-1930718fcb50', 'volume_size': 1} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43f277c-08f4-4e5d-a042-1930718fcb50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f6d5ef2314882b5957f0fcad3e1a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:53Z,use_quota=True,user_id='9d9651b30d664b09b6ed8d21306fd275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Creating volume b43f277c-08f4-4e5d-a042-1930718fcb50 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:53 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:53 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4cd20cef-e714-47bd-abd0-1accc18cda56" returned: 0 in 0.380s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:53 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50 1073741824 Nov 04 19:11:53 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-4cd20cef-e714-47bd-abd0-1accc18cda56" released by "delete_volume" :: held 1.079s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created reservations ['6a733ce5-0dcd-45fa-89cf-7f1ad3ed8518', '6aa0e85c-aaf5-41ec-9c5f-ca7c7fd40e37', 'f788f19c-d86b-469a-9680-6262766ecccf', '75fe874b-2483-496d-ae74-ec8eee4571a8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:53 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:53 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:54 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.366s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Deleted volume successfully. Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c547f75e-f7c0-4882-81de-baabba7afafb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-4cd20cef-e714-47bd-abd0-1accc18cda56-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:54 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50 1073741824" returned: 0 in 0.762s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:54 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50 Nov 04 19:11:54 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:54 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50" returned: 0 in 0.354s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2fa3e2-cfb9-4f38-a021-e71fdcc60bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43f277c-08f4-4e5d-a042-1930718fcb50', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dbef73-e838-4a26-8149-c6cef32a8728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:54 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Volume volume-b43f277c-08f4-4e5d-a042-1930718fcb50 (b43f277c-08f4-4e5d-a042-1930718fcb50): created successfully Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dbef73-e838-4a26-8149-c6cef32a8728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Flow 'volume_create_manager' (2d2ef28a-cc3e-4530-9f3e-f3f5b5c4ac40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:54 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a7410326-f95a-4d63-a9dd-3a6927a13c2d tempest-CinderUnicodeTest-47005159 None] Created volume successfully. Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-0e27b742-ccdb-4cd5-940a-ad1a3859ad00-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-0e27b742-ccdb-4cd5-940a-ad1a3859ad00-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Flow 'volume_create_manager' (be5b5010-e929-4dee-a237-c9c077450781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ec2f96-3efe-439c-a2f4-a2f2f2a862d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-quobyte-0e27b742-ccdb-4cd5-940a-ad1a3859ad00" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ec2f96-3efe-439c-a2f4-a2f2f2a862d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1328642026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc896593-3424-4065-bcdd-a8cdd1c6f256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06197288e43949d69ecb68352ab3789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:55Z,use_quota=True,user_id='b21c833038354de88cad4a0da9b8a267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7556c28a-d618-4551-9cf7-e1b8a45b4c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7556c28a-d618-4551-9cf7-e1b8a45b4c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e677b06-7d72-41e4-be23-782c882323d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e677b06-7d72-41e4-be23-782c882323d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc896593-3424-4065-bcdd-a8cdd1c6f256', 'volume_name': 'volume-cc896593-3424-4065-bcdd-a8cdd1c6f256', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce22a62-414c-4f1e-b929-26558239770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce22a62-414c-4f1e-b929-26558239770a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b788eaba-918b-443b-8fee-d509d11e9d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:54 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Volume cc896593-3424-4065-bcdd-a8cdd1c6f256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc896593-3424-4065-bcdd-a8cdd1c6f256', 'volume_size': 1} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1328642026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc896593-3424-4065-bcdd-a8cdd1c6f256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06197288e43949d69ecb68352ab3789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:55Z,use_quota=True,user_id='b21c833038354de88cad4a0da9b8a267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Creating volume cc896593-3424-4065-bcdd-a8cdd1c6f256 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:54 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:54 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 1073741824 Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-0e27b742-ccdb-4cd5-940a-ad1a3859ad00" acquired by "delete_volume" :: waited 0.091s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:54 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[52892a76-f2fb-40ad-8ec1-ebb45482397a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:55 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00 Nov 04 19:11:55 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:55 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00" returned: 0 in 0.493s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:55 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 1073741824" returned: 0 in 0.578s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:55 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00 Nov 04 19:11:55 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:55 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 Nov 04 19:11:55 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:55 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-0e27b742-ccdb-4cd5-940a-ad1a3859ad00" returned: 0 in 0.331s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-0e27b742-ccdb-4cd5-940a-ad1a3859ad00" released by "delete_volume" :: held 0.896s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:55 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256" returned: 0 in 0.400s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created reservations ['7c0478e3-b4b9-4c36-9618-60f8c6a7e914', '5c8bee5f-80ef-437f-b4e0-83d4c2e3ce6b', '41a31b4e-b9dd-478e-b982-2e640de631f4', 'caffdbcd-bf75-4832-a80f-0e7f048017bf'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b788eaba-918b-443b-8fee-d509d11e9d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc896593-3424-4065-bcdd-a8cdd1c6f256', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe771cd-a87f-40ff-8918-69eb2e6d66c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:55 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Volume volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 (cc896593-3424-4065-bcdd-a8cdd1c6f256): created successfully Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe771cd-a87f-40ff-8918-69eb2e6d66c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Flow 'volume_create_manager' (be5b5010-e929-4dee-a237-c9c077450781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:56 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-66d8d8f8-3d1d-4469-8376-6a95f809f584 tempest-VolumeDependencyTests-1712848092 None] Created volume successfully. Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:56 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:11:56 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Flow 'volume_create_manager' (f01fa6bb-dfc6-4ac2-a243-945d0f04b536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13473f4-2912-420e-81b4-e6484fa7ce61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13473f4-2912-420e-81b4-e6484fa7ce61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-87678176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122fff4c-e0dc-41e4-be66-6ea571565b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f6d5ef2314882b5957f0fcad3e1a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:56Z,use_quota=True,user_id='9d9651b30d664b09b6ed8d21306fd275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3af97f1-1b58-4631-8528-f8276c83ae84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3af97f1-1b58-4631-8528-f8276c83ae84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c53c38-a9bd-45cc-b184-b4dc368b1fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c53c38-a9bd-45cc-b184-b4dc368b1fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122fff4c-e0dc-41e4-be66-6ea571565b58', 'volume_name': 'volume-122fff4c-e0dc-41e4-be66-6ea571565b58', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd86e4e-bc0b-4950-8975-2c42a1363b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd86e4e-bc0b-4950-8975-2c42a1363b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a512b9-55a9-41a9-a82a-86e1a53d2fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:56 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Volume 122fff4c-e0dc-41e4-be66-6ea571565b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122fff4c-e0dc-41e4-be66-6ea571565b58', 'volume_size': 1} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:11:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-87678176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122fff4c-e0dc-41e4-be66-6ea571565b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5f6d5ef2314882b5957f0fcad3e1a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:11:56Z,use_quota=True,user_id='9d9651b30d664b09b6ed8d21306fd275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Creating volume 122fff4c-e0dc-41e4-be66-6ea571565b58 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:11:56 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:56 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 1073741824 Nov 04 19:11:56 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:56 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.298s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:56 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Deleted volume successfully. Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d5f567ca-0301-453f-b1d1-f8891fa5e5eb tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-0e27b742-ccdb-4cd5-940a-ad1a3859ad00-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:56 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 1073741824" returned: 0 in 0.520s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:56 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 Nov 04 19:11:56 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-4503f117-1fa1-4dae-b58e-61af0cbf6032-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-4503f117-1fa1-4dae-b58e-61af0cbf6032-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:57 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58" returned: 0 in 0.386s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.143s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-quobyte-4503f117-1fa1-4dae-b58e-61af0cbf6032" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] Creating offline snapshot 8d120c92-5827-42ec-ad07-097d95191241 of volume cc896593-3424-4065-bcdd-a8cdd1c6f256 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a512b9-55a9-41a9-a82a-86e1a53d2fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122fff4c-e0dc-41e4-be66-6ea571565b58', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9ff0bc-53e8-4042-9d1a-8f662721b57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f11fe0-7039-4956-a004-03eca8b8a88d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-4503f117-1fa1-4dae-b58e-61af0cbf6032" acquired by "delete_volume" :: waited 0.059s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f20c74-2c7e-49a1-8ac9-ddaf6826c2d9]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:57 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Volume volume-122fff4c-e0dc-41e4-be66-6ea571565b58 (122fff4c-e0dc-41e4-be66-6ea571565b58): created successfully Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9ff0bc-53e8-4042-9d1a-8f662721b57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Flow 'volume_create_manager' (f01fa6bb-dfc6-4ac2-a243-945d0f04b536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:11:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9b757416-588b-4d4b-b5db-472d6427adaf tempest-CinderUnicodeTest-47005159 None] Created volume successfully. Nov 04 19:11:57 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 Nov 04 19:11:57 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:57 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032 Nov 04 19:11:57 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:57 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256" returned: 0 in 0.427s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:57 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032" returned: 0 in 0.445s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:57 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 1G Nov 04 19:11:57 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:57 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032 Nov 04 19:11:57 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:57 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4503f117-1fa1-4dae-b58e-61af0cbf6032" returned: 0 in 0.279s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-4503f117-1fa1-4dae-b58e-61af0cbf6032" released by "delete_volume" :: held 0.787s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created reservations ['117c544f-cba2-4f06-a4db-d2f86189b38f', 'd541e199-50f7-405c-b736-302a56039ff2', '80899914-5fd3-4b31-8ff1-b31976a3b66b', '0e87fcd0-f9c2-4edc-8364-45914977ef41'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:58 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 1G" returned: 0 in 0.575s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:58 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:58 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:58 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 Nov 04 19:11:58 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-a1810d3f-e413-4ead-9256-c03a15276914-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-a1810d3f-e413-4ead-9256-c03a15276914-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-quobyte-a1810d3f-e413-4ead-9256-c03a15276914" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-a1810d3f-e413-4ead-9256-c03a15276914" acquired by "delete_volume" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f041c5-6505-4059-a86c-1078a2b5f14a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:58 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.487s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:58 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Deleted volume successfully. Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-2303134b-2903-4aed-b2f6-fd21ddc20275 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-4503f117-1fa1-4dae-b58e-61af0cbf6032-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:58 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914 Nov 04 19:11:58 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:58 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241" returned: 0 in 0.545s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:58 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 is being set with open permissions: ugo+rw Nov 04 19:11:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:58 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 Nov 04 19:11:58 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:59 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:59 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241" returned: 0 in 0.282s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914" returned: 0 in 0.484s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:59 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914 Nov 04 19:11:59 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:59 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.info Nov 04 19:11:59 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:59 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a1810d3f-e413-4ead-9256-c03a15276914" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-a1810d3f-e413-4ead-9256-c03a15276914" released by "delete_volume" :: held 0.837s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created reservations ['8f29e2fe-2fa4-4ab9-9c89-65a6d37b82cd', '6d328f74-520d-48e4-b74d-946ac4d8bf0a', '51000075-6ba8-484f-9085-ae0af5b21f00', 'b82c6b6a-b7c0-4c6d-95f1-7544b05711f3'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:11:59 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.info" returned: 0 in 0.335s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:59 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.info is being set with open permissions: ugo+rw Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:59 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.info Nov 04 19:11:59 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:59 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:11:59 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:11:59 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.info" returned: 0 in 0.304s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.638s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.178s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] Creating offline snapshot a5d5fdd0-b996-435d-a37c-ff3940a25719 of volume 122fff4c-e0dc-41e4-be66-6ea571565b58 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:11:59 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f5602b8e-f1be-4e86-a9a3-561497caec84 tempest-VolumeDependencyTests-1712848092 None] Create snapshot completed successfully Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6129822-99f8-40ac-81b4-f0229b41c436]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:11:59 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.300s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:11:59 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Deleted volume successfully. Nov 04 19:11:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b2e1db42-a4bc-4671-9bf4-f3adcceee41b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-a1810d3f-e413-4ead-9256-c03a15276914-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:11:59 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 Nov 04 19:11:59 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:00 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58" returned: 0 in 0.399s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:00 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 1G Nov 04 19:12:00 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-f57d5b4d-4d2d-439a-9b64-8e2300478951-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-f57d5b4d-4d2d-439a-9b64-8e2300478951-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-quobyte-01f77e35-7751-4cc5-a834-4657e6b30e26" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-01f77e35-7751-4cc5-a834-4657e6b30e26" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-quobyte-f57d5b4d-4d2d-439a-9b64-8e2300478951" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-f57d5b4d-4d2d-439a-9b64-8e2300478951" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Deleting offline snapshot f57d5b4d-4d2d-439a-9b64-8e2300478951 of volume 01f77e35-7751-4cc5-a834-4657e6b30e26 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] snapshot_file for this snap is: volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:00 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 1G" returned: 0 in 0.630s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-122fff4c-e0dc-41e4-be66-6ea571565b58 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ada2005-75be-43e3-a253-15281ff6628a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:00 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-122fff4c-e0dc-41e4-be66-6ea571565b58 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 Nov 04 19:12:00 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:00 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Flow 'volume_create_manager' (e558f840-6fdd-4618-a9b5-3d36faee975e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8743f823-b67d-4254-a7d3-c4094dd6d77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8743f823-b67d-4254-a7d3-c4094dd6d77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1274662057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adce3cf1-6a1a-40a2-b894-e4093ecb7d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06197288e43949d69ecb68352ab3789a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8d120c92-5827-42ec-ad07-097d95191241,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:01Z,use_quota=True,user_id='b21c833038354de88cad4a0da9b8a267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16a9728-fb37-4ce9-b82f-082f4d3c1239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16a9728-fb37-4ce9-b82f-082f4d3c1239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82fabd2-855b-4732-9ae3-69d3fdff7d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82fabd2-855b-4732-9ae3-69d3fdff7d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'adce3cf1-6a1a-40a2-b894-e4093ecb7d5d', 'volume_name': 'volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d', 'volume_size': 1, 'snapshot_id': '8d120c92-5827-42ec-ad07-097d95191241'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3a9e11-6b31-4181-aa09-757c7b8603a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3a9e11-6b31-4181-aa09-757c7b8603a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeed6302-a360-4ee1-8c59-5928ef2b6442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:01 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Volume adce3cf1-6a1a-40a2-b894-e4093ecb7d5d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d', 'volume_size': 1, 'snapshot_id': '8d120c92-5827-42ec-ad07-097d95191241'} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:01 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 Nov 04 19:12:01 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:01 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-122fff4c-e0dc-41e4-be66-6ea571565b58 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719" returned: 0 in 0.369s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:01 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 is being set with open permissions: ugo+rw Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:01 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 Nov 04 19:12:01 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:01 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951" returned: 0 in 0.548s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01f77e35-7751-4cc5-a834-4657e6b30e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e024dceb-3b07-43bd-9c06-44a0ec5ddb29]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:01 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719" returned: 0 in 0.284s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:01 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.info Nov 04 19:12:01 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:01 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 Nov 04 19:12:01 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:01 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.info" returned: 0 in 0.297s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:01 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.info is being set with open permissions: ugo+rw Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:01 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.info Nov 04 19:12:01 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:01 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26" returned: 0 in 0.476s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:02 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 Nov 04 19:12:02 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:02 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.info" returned: 0 in 0.292s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.081s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "cinder-quobyte-8d120c92-5827-42ec-ad07-097d95191241-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" by "_create_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-8d120c92-5827-42ec-ad07-097d95191241-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Creating volume adce3cf1-6a1a-40a2-b894-e4093ecb7d5d from snapshot 8d120c92-5827-42ec-ad07-097d95191241 {{(pid=87364) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "cinder-quobyte-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:02 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-cd6bc376-49ab-4429-807e-02c37b760360 tempest-CinderUnicodeTest-47005159 None] Create snapshot completed successfully Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] snapshot: 8d120c92-5827-42ec-ad07-097d95191241, volume: adce3cf1-6a1a-40a2-b894-e4093ecb7d5d, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e4edc7-ffce-44cc-878d-8011d7cf93af]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:02 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951" returned: 0 in 0.420s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:02 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951 Nov 04 19:12:02 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:02 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 Nov 04 19:12:02 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:02 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26.f57d5b4d-4d2d-439a-9b64-8e2300478951" returned: 0 in 0.311s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:02 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241" returned: 0 in 0.432s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc896593-3424-4065-bcdd-a8cdd1c6f256(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-f57d5b4d-4d2d-439a-9b64-8e2300478951" released by "_delete_snapshot" :: held 1.941s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-01f77e35-7751-4cc5-a834-4657e6b30e26" released by "delete_snapshot" :: held 1.978s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0f2076-7c80-4bfd-88b4-38881100450c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Acquiring lock "cinder-a5d5fdd0-b996-435d-a37c-ff3940a25719-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-a5d5fdd0-b996-435d-a37c-ff3940a25719-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Acquiring lock "cinder-quobyte-122fff4c-e0dc-41e4-be66-6ea571565b58" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-quobyte-122fff4c-e0dc-41e4-be66-6ea571565b58" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Acquiring lock "cinder-quobyte-a5d5fdd0-b996-435d-a37c-ff3940a25719" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-quobyte-a5d5fdd0-b996-435d-a37c-ff3940a25719" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Deleting offline snapshot a5d5fdd0-b996-435d-a37c-ff3940a25719 of volume 122fff4c-e0dc-41e4-be66-6ea571565b58 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] snapshot_file for this snap is: volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created reservations ['a52e9baa-3f20-4b0b-8330-28ade8619e62', '0876bb18-2cbb-47ca-ad2c-39af67ef6006', '946a0e10-aea4-44bb-b46e-ade3fb46a5a8', '1ab7ceba-b570-4348-921e-54bed82567b8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:02 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 Nov 04 19:12:02 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b86491e-4c9d-4526-82be-35051ef2b109]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:03 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Delete snapshot completed successfully. Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-159cc760-9e27-475b-b62d-9dc5e5ed706b tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-f57d5b4d-4d2d-439a-9b64-8e2300478951-delete_snapshot" released by "delete_snapshot" :: held 2.318s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:03 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 Nov 04 19:12:03 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:03 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256" returned: 0 in 0.491s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:03 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d Nov 04 19:12:03 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:03 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719" returned: 0 in 0.449s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-122fff4c-e0dc-41e4-be66-6ea571565b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ef124f-ca33-4df5-8644-5e374b2cc09a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:03 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 Nov 04 19:12:03 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Flow 'volume_create_manager' (8afed309-53da-4e71-a507-2b67e62b7404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5edd221-2f0f-4af7-9569-8bd27f90502c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5edd221-2f0f-4af7-9569-8bd27f90502c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-594676201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61252b3d-8583-4733-a6cd-970cdc6d7aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a301738da044da8c7d8237afd4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:04Z,use_quota=True,user_id='9d535f9167674e209771286d2fb6c797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac47b6e-8c4b-47fb-bfa7-65f195dbffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac47b6e-8c4b-47fb-bfa7-65f195dbffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e361c56f-1992-47e2-ad05-8f92869c2468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e361c56f-1992-47e2-ad05-8f92869c2468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61252b3d-8583-4733-a6cd-970cdc6d7aa4', 'volume_name': 'volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d366c58-b309-4487-9c2c-94619a0964bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d366c58-b309-4487-9c2c-94619a0964bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5c8214-b4f2-4773-b66b-7c27b2ca73e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:03 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Volume 61252b3d-8583-4733-a6cd-970cdc6d7aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4', 'volume_size': 1} Nov 04 19:12:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:04 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58" returned: 0 in 0.525s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-01f77e35-7751-4cc5-a834-4657e6b30e26-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-01f77e35-7751-4cc5-a834-4657e6b30e26-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:04 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 Nov 04 19:12:04 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "cinder-quobyte-01f77e35-7751-4cc5-a834-4657e6b30e26" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-01f77e35-7751-4cc5-a834-4657e6b30e26" acquired by "delete_volume" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[be73d790-64c2-44a0-8b9c-8ad38a4c0064]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:04 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 Nov 04 19:12:04 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:04 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719" returned: 0 in 0.706s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:04 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719 Nov 04 19:12:04 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:04 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26" returned: 0 in 0.681s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:05 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26 Nov 04 19:12:05 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:05 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58.a5d5fdd0-b996-435d-a37c-ff3940a25719" returned: 0 in 0.471s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-quobyte-a5d5fdd0-b996-435d-a37c-ff3940a25719" released by "_delete_snapshot" :: held 2.425s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-quobyte-122fff4c-e0dc-41e4-be66-6ea571565b58" released by "delete_snapshot" :: held 2.479s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Created reservations ['96990d6a-3df4-4d08-9088-624e31d61475', '10e947c4-b73e-431e-bfbb-1338308829dc', '2617b22c-73cf-4742-adb2-a6c89c9cf35b', '43c91655-2abe-4958-bc0a-91ab5ef18368'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:05 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01f77e35-7751-4cc5-a834-4657e6b30e26" returned: 0 in 0.564s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-quobyte-01f77e35-7751-4cc5-a834-4657e6b30e26" released by "delete_volume" :: held 1.403s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Delete snapshot completed successfully. Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-9590c589-02bb-4bdd-aaac-76a2e9bcb5f1 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-a5d5fdd0-b996-435d-a37c-ff3940a25719-delete_snapshot" released by "delete_snapshot" :: held 2.827s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Created reservations ['a14b1243-5235-4286-b1de-3802ec9b8ab1', '14e24109-3e52-47a3-87a0-8c7ce3bdfa0d', '0a0c8643-a5b2-4dbd-863f-b21dc740e485', 'f0fc4328-28a6-45c1-b78e-4df210189ea9'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:05 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:05 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:06 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.310s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:06 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:06 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Deleted volume successfully. Nov 04 19:12:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54112982-a3ab-4920-8013-b55d6cb42715 tempest-CreateVolumesFromSnapshotTest-1904364708 None] Lock "cinder-01f77e35-7751-4cc5-a834-4657e6b30e26-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Acquiring lock "cinder-122fff4c-e0dc-41e4-be66-6ea571565b58-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-122fff4c-e0dc-41e4-be66-6ea571565b58-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Acquiring lock "cinder-quobyte-122fff4c-e0dc-41e4-be66-6ea571565b58" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-quobyte-122fff4c-e0dc-41e4-be66-6ea571565b58" acquired by "delete_volume" :: waited 0.038s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:06 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[332b7dec-4876-4047-96bc-1fdc352f7692]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:06 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 Nov 04 19:12:06 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:07 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58" returned: 0 in 0.629s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:07 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58 Nov 04 19:12:07 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:07 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-122fff4c-e0dc-41e4-be66-6ea571565b58" returned: 0 in 0.473s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-quobyte-122fff4c-e0dc-41e4-be66-6ea571565b58" released by "delete_volume" :: held 1.235s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:07 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Created reservations ['b05c0eab-019e-4257-895b-f116a50cb59a', '4d6af794-f8b2-4a1b-80a5-1c6032c89de7', '85b9e76f-2285-4dc2-ba65-e1c4be40ebe1', 'b4d2238c-c408-4516-aa4e-62d7f4096844'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:07 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:08 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:08 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:08 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.455s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:08 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:08 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Deleted volume successfully. Nov 04 19:12:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-c9fbcbf9-fe64-4333-8d0e-a8c033dd5c77 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-122fff4c-e0dc-41e4-be66-6ea571565b58-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Acquiring lock "cinder-b43f277c-08f4-4e5d-a042-1930718fcb50-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-b43f277c-08f4-4e5d-a042-1930718fcb50-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Acquiring lock "cinder-quobyte-b43f277c-08f4-4e5d-a042-1930718fcb50" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-quobyte-b43f277c-08f4-4e5d-a042-1930718fcb50" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:08 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90f1b54-e7f3-4d4c-8f43-6a79d76a9e35]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:09 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50 Nov 04 19:12:09 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:09 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50" returned: 0 in 0.919s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:09 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50 Nov 04 19:12:09 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:10 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-b43f277c-08f4-4e5d-a042-1930718fcb50" returned: 0 in 0.721s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:10 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-quobyte-b43f277c-08f4-4e5d-a042-1930718fcb50" released by "delete_volume" :: held 1.748s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:10 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Created reservations ['7ee829b9-2d57-4456-bafb-6ac4285fdbec', 'ced843bc-8944-4c59-a373-09d3096e5766', '281745b8-d1ca-4cff-a4f8-0e2e110ff23c', '8780c08a-2af5-4360-a41f-07e675a1f05d'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:10 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:10 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:11 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" returned: 0 in 8.039s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256, size 1024.00 MB, duration 8.04 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:12:11 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Converted 1024.00 MB image at 127.35 MB/s Nov 04 19:12:11 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d is being set with open permissions: ugo+rw Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:11 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d Nov 04 19:12:11 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:11 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.476s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:11 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Deleted volume successfully. Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-164c9753-137a-4742-a7e2-490d06e4bc90 tempest-CinderUnicodeTest-47005159 None] Lock "cinder-b43f277c-08f4-4e5d-a042-1930718fcb50-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:11 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" returned: 0 in 0.286s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" released by "_copy_volume_from_snapshot" :: held 9.360s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-8d120c92-5827-42ec-ad07-097d95191241-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" released by "_create_volume_from_snapshot" :: held 9.440s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.475s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.990s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-594676201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61252b3d-8583-4733-a6cd-970cdc6d7aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a301738da044da8c7d8237afd4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:04Z,use_quota=True,user_id='9d535f9167674e209771286d2fb6c797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Creating volume 61252b3d-8583-4733-a6cd-970cdc6d7aa4 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:11 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:11 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 1073741824 Nov 04 19:12:11 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeed6302-a360-4ee1-8c59-5928ef2b6442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d', 'volume_size': 1, 'snapshot_id': '8d120c92-5827-42ec-ad07-097d95191241'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3064b7ad-5f8b-4ab6-bdfc-387207c4a264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:11 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Volume volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d (adce3cf1-6a1a-40a2-b894-e4093ecb7d5d): created successfully Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3064b7ad-5f8b-4ab6-bdfc-387207c4a264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Flow 'volume_create_manager' (e558f840-6fdd-4618-a9b5-3d36faee975e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:11 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b0e1942f-43d0-48b3-9197-af4c67e157ea tempest-VolumeDependencyTests-1712848092 None] Created volume successfully. Nov 04 19:12:11 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "cinder-8d120c92-5827-42ec-ad07-097d95191241-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (9958b50d-6c9d-4e67-88e3-106fb2bc418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a2c54f-c9e9-48d7-8fd5-ca748feb11e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-8d120c92-5827-42ec-ad07-097d95191241-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "cinder-quobyte-cc896593-3424-4065-bcdd-a8cdd1c6f256" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a2c54f-c9e9-48d7-8fd5-ca748feb11e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-564413379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac48f0e-d53f-488a-ad42-0ccb8b94e41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:12Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d57a78-a5de-4277-bda9-eaf3083bd41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d57a78-a5de-4277-bda9-eaf3083bd41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcfd4ef-cf9e-43a7-a026-e71156ffb3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcfd4ef-cf9e-43a7-a026-e71156ffb3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac48f0e-d53f-488a-ad42-0ccb8b94e41b', 'volume_name': 'volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba36e432-605e-4087-9e9e-74002ec6e2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba36e432-605e-4087-9e9e-74002ec6e2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6f2930-ab7c-42bc-853b-53dd926db3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:12 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume eac48f0e-d53f-488a-ad42-0ccb8b94e41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b', 'volume_size': 1} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-cc896593-3424-4065-bcdd-a8cdd1c6f256" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "cinder-quobyte-8d120c92-5827-42ec-ad07-097d95191241" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-8d120c92-5827-42ec-ad07-097d95191241" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Deleting offline snapshot 8d120c92-5827-42ec-ad07-097d95191241 of volume cc896593-3424-4065-bcdd-a8cdd1c6f256 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] snapshot_file for this snap is: volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7dbca0-74d9-4007-97e8-3feeaef67e1d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:12 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 1073741824" returned: 0 in 0.587s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:12 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 Nov 04 19:12:12 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:12 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 Nov 04 19:12:12 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:12 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241" returned: 0 in 0.414s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc896593-3424-4065-bcdd-a8cdd1c6f256(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:12 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4" returned: 0 in 0.290s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-564413379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac48f0e-d53f-488a-ad42-0ccb8b94e41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:12Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Creating volume eac48f0e-d53f-488a-ad42-0ccb8b94e41b {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:12 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a31e6e-9a77-4615-931c-9c3a31b90a26]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:12 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b 1073741824 Nov 04 19:12:12 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5c8214-b4f2-4773-b66b-7c27b2ca73e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8737ce-d319-4d39-92c9-6e6e4b8a7b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:12 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Volume volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 (61252b3d-8583-4733-a6cd-970cdc6d7aa4): created successfully Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8737ce-d319-4d39-92c9-6e6e4b8a7b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:12 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Flow 'volume_create_manager' (8afed309-53da-4e71-a507-2b67e62b7404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:12 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a057dc81-40ed-4159-a8d2-e2aa9a0274a8 tempest-ProjectReaderTests-1979060275 None] Created volume successfully. Nov 04 19:12:12 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 Nov 04 19:12:12 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:13 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b 1073741824" returned: 0 in 0.521s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:13 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b Nov 04 19:12:13 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:13 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256" returned: 0 in 0.656s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:13 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 Nov 04 19:12:13 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:13 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b" returned: 0 in 0.300s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6f2930-ab7c-42bc-853b-53dd926db3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17134067-41e8-4934-886b-055bd5ff3b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:13 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b (eac48f0e-d53f-488a-ad42-0ccb8b94e41b): created successfully Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17134067-41e8-4934-886b-055bd5ff3b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (9958b50d-6c9d-4e67-88e3-106fb2bc418c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:13 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ed402465-2c93-4936-bc09-add32a3e48c7 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created volume successfully. Nov 04 19:12:13 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241" returned: 0 in 0.407s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:13 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241 Nov 04 19:12:13 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] Creating offline snapshot 947b2683-0c5e-49ab-b46f-2fdf57dd8c20 of volume 61252b3d-8583-4733-a6cd-970cdc6d7aa4 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d135f2e3-d1c9-4eec-b3b8-a12cf228c42c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:14 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256.8d120c92-5827-42ec-ad07-097d95191241" returned: 0 in 0.295s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:14 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 Nov 04 19:12:14 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-8d120c92-5827-42ec-ad07-097d95191241" released by "_delete_snapshot" :: held 1.965s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-cc896593-3424-4065-bcdd-a8cdd1c6f256" released by "delete_snapshot" :: held 2.008s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Created reservations ['2139f322-1d76-457d-b7be-8f3c84586b6e', '7b326aaa-aa5a-4c89-a497-1670162b6337', '437adf7e-8fea-40a0-916d-34f7bda0d60a', '9e50c2dc-2e6e-4b77-993c-b6655f81e0cd'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:14 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Delete snapshot completed successfully. Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5956814c-102e-4d6e-aa2c-db82d04ff928 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-8d120c92-5827-42ec-ad07-097d95191241-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:14 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4" returned: 0 in 0.494s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:14 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 1G Nov 04 19:12:14 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (be3d2e4b-225d-48c7-ab43-f2fbc759b591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d034bdf-d796-4e4c-914d-a3fe03b963df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d034bdf-d796-4e4c-914d-a3fe03b963df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1572694049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:15Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cce51e-7c96-4801-b636-303a1fe03bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cce51e-7c96-4801-b636-303a1fe03bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc9fb4d-b284-4e40-804d-90ebd89facda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc9fb4d-b284-4e40-804d-90ebd89facda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31', 'volume_name': 'volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be8a9e2-5960-4a41-bf2f-7da210c3985e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be8a9e2-5960-4a41-bf2f-7da210c3985e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc8fe99-cd56-4261-8fa1-679b5809e5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:14 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume 7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31', 'volume_size': 1} Nov 04 19:12:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:14 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 1G" returned: 0 in 0.593s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:15 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 Nov 04 19:12:15 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (7e6a6f9a-5cc8-4ecf-a017-d81e51efd89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570e5ca3-5629-4c18-b361-d44e901a006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570e5ca3-5629-4c18-b361-d44e901a006e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1884029040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afec1b76-25c3-43fd-995d-5f758ab5a125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:15Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd6fe38-d43c-4531-884b-c1f08b1cd2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd6fe38-d43c-4531-884b-c1f08b1cd2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d49fc8-f276-4525-9887-c102cc9cce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d49fc8-f276-4525-9887-c102cc9cce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afec1b76-25c3-43fd-995d-5f758ab5a125', 'volume_name': 'volume-afec1b76-25c3-43fd-995d-5f758ab5a125', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecef0236-309e-4b78-bd83-7ad6024f2c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecef0236-309e-4b78-bd83-7ad6024f2c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4770bbe8-4406-426a-970b-82c04574cb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:15 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume afec1b76-25c3-43fd-995d-5f758ab5a125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afec1b76-25c3-43fd-995d-5f758ab5a125', 'volume_size': 1} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-4673ed03-82b0-4124-80e4-8272a64c98e9 tempest-ProjectAdminTests-936520396 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5831718444824, 'free_capacity_gb': 1773.5831718444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87364) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "cinder-cc896593-3424-4065-bcdd-a8cdd1c6f256-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-cc896593-3424-4065-bcdd-a8cdd1c6f256-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "cinder-quobyte-cc896593-3424-4065-bcdd-a8cdd1c6f256" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-cc896593-3424-4065-bcdd-a8cdd1c6f256" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:15 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20" returned: 0 in 0.491s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:15 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 is being set with open permissions: ugo+rw Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d5ac9e-39f3-41a2-957e-3149eb26bfd1]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:15 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 Nov 04 19:12:15 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (4dacb9ab-b2a3-4765-b311-e8fa25f5e22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8935a5a7-2e90-4998-b25e-00c60061d3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8935a5a7-2e90-4998-b25e-00c60061d3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974946878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d8d0b7-0421-4410-98af-b2f8dccf659d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:16Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:15 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 Nov 04 19:12:15 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b97baa-beb3-4424-9bdc-ace1587f9811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b97baa-beb3-4424-9bdc-ace1587f9811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4990e2-0f7d-400f-9db7-054a2b318229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4990e2-0f7d-400f-9db7-054a2b318229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d8d0b7-0421-4410-98af-b2f8dccf659d', 'volume_name': 'volume-45d8d0b7-0421-4410-98af-b2f8dccf659d', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d003c4f8-96da-4010-a7c0-1952f8612019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d003c4f8-96da-4010-a7c0-1952f8612019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca01bf39-6140-4ce0-9f1f-91364d2b75da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:15 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume 45d8d0b7-0421-4410-98af-b2f8dccf659d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d8d0b7-0421-4410-98af-b2f8dccf659d', 'volume_size': 1} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:15 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20" returned: 0 in 0.395s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:15 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.info Nov 04 19:12:15 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:16 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256" returned: 0 in 0.628s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:16 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256 Nov 04 19:12:16 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (a8dd7c05-ba68-4e06-9cb6-28cae5c37014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523104d5-07fa-47d8-aa18-1478254b3913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:16 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:16 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523104d5-07fa-47d8-aa18-1478254b3913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097598294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa156b3-ccf0-42b4-8717-e82dd36c16b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:16Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bfb8a0-acd9-4cca-b9ac-a1a395a033aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bfb8a0-acd9-4cca-b9ac-a1a395a033aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e53f99-8a3c-40f2-a9e7-0014b12fbe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e53f99-8a3c-40f2-a9e7-0014b12fbe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa156b3-ccf0-42b4-8717-e82dd36c16b4', 'volume_name': 'volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2417f2f8-7e2d-432e-9fb6-80690d0f0350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2417f2f8-7e2d-432e-9fb6-80690d0f0350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7252334-58be-4007-ba93-6251ead4359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:16 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume 3fa156b3-ccf0-42b4-8717-e82dd36c16b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4', 'volume_size': 1} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:16 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.info" returned: 0 in 0.525s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:16 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.info is being set with open permissions: ugo+rw Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:16 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.info Nov 04 19:12:16 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:16 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-cc896593-3424-4065-bcdd-a8cdd1c6f256" returned: 0 in 0.529s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-cc896593-3424-4065-bcdd-a8cdd1c6f256" released by "delete_volume" :: held 1.285s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:16 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.604s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:16 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (b5cbfbdf-852c-4c7e-b80a-97b7c4b75067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1d4cd4-eb4c-417b-8e9d-5040d3c1fa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.info" returned: 0 in 0.480s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Created reservations ['a6b8835f-8d54-4dfc-b2c7-003984a16320', 'b1beae81-b458-4ac8-81b2-4106094e2427', 'c1e94166-5429-454e-bf11-c5ca7da0dfaa', '64298b8e-4700-4697-8ec4-0010666e20dd'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.095s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.229s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1572694049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:15Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Creating volume 7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:16 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:17 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31 1073741824 Nov 04 19:12:17 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1d4cd4-eb4c-417b-8e9d-5040d3c1fa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1740596864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87141338-57ef-4e60-98d9-ca52214bd73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:17Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71bed5c-3f08-43a3-965c-f6f347676472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71bed5c-3f08-43a3-965c-f6f347676472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a74a71f-7d63-4203-8980-fded57a1a44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a74a71f-7d63-4203-8980-fded57a1a44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87141338-57ef-4e60-98d9-ca52214bd73e', 'volume_name': 'volume-87141338-57ef-4e60-98d9-ca52214bd73e', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372ba2ba-dbcc-4110-b96d-e6a0038e5266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372ba2ba-dbcc-4110-b96d-e6a0038e5266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cd8644-f0b6-4b11-bb47-fbbf72e9b96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:17 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume 87141338-57ef-4e60-98d9-ca52214bd73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87141338-57ef-4e60-98d9-ca52214bd73e', 'volume_size': 1} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:17 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-bfb61d4d-b07f-4ec7-bc2c-b9b504a46590 tempest-ProjectReaderTests-1979060275 None] Create snapshot completed successfully Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:17 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:17 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:17 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.374s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:17 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Deleted volume successfully. Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-79ed36ad-a4b6-4631-ace5-e98a1fdf9798 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-cc896593-3424-4065-bcdd-a8cdd1c6f256-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:17 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31 1073741824" returned: 0 in 0.597s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:17 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31 Nov 04 19:12:17 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-947b2683-0c5e-49ab-b46f-2fdf57dd8c20-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-947b2683-0c5e-49ab-b46f-2fdf57dd8c20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-61252b3d-8583-4733-a6cd-970cdc6d7aa4" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-61252b3d-8583-4733-a6cd-970cdc6d7aa4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-947b2683-0c5e-49ab-b46f-2fdf57dd8c20" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-947b2683-0c5e-49ab-b46f-2fdf57dd8c20" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Deleting offline snapshot 947b2683-0c5e-49ab-b46f-2fdf57dd8c20 of volume 61252b3d-8583-4733-a6cd-970cdc6d7aa4 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] snapshot_file for this snap is: volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[47593f90-8ae4-4ee8-b93d-c483e47a3a13]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:17 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31" returned: 0 in 0.355s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.843s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1884029040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afec1b76-25c3-43fd-995d-5f758ab5a125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:15Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Creating volume afec1b76-25c3-43fd-995d-5f758ab5a125 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:18 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:18 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 Nov 04 19:12:18 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "cinder-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc8fe99-cd56-4261-8fa1-679b5809e5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:18 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125 1073741824 Nov 04 19:12:18 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e48773-5358-403b-a9b0-8debd1fd0784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:18 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31 (7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31): created successfully Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e48773-5358-403b-a9b0-8debd1fd0784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (be3d2e4b-225d-48c7-ab43-f2fbc759b591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:18 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f6c938e9-aba5-4150-b169-35ee4b6f75af tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created volume successfully. Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "cinder-quobyte-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[238eb629-8f3a-4c75-bf47-4e177fe834a2]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:18 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20" returned: 0 in 0.460s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:18 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d Nov 04 19:12:18 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[769509b3-31e5-4cb2-b456-823c6fa4cec3]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:18 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 Nov 04 19:12:18 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:18 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125 1073741824" returned: 0 in 0.570s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:18 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125 Nov 04 19:12:18 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:18 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" returned: 0 in 0.535s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:18 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d Nov 04 19:12:18 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:18 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4" returned: 0 in 0.507s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:18 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 Nov 04 19:12:18 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:19 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125" returned: 0 in 0.383s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.266s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974946878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d8d0b7-0421-4410-98af-b2f8dccf659d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:16Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Creating volume 45d8d0b7-0421-4410-98af-b2f8dccf659d {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:19 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4770bbe8-4406-426a-970b-82c04574cb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afec1b76-25c3-43fd-995d-5f758ab5a125', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e84cd1-e28d-40fe-a74a-dff8cf929920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:19 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d 1073741824 Nov 04 19:12:19 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:19 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume volume-afec1b76-25c3-43fd-995d-5f758ab5a125 (afec1b76-25c3-43fd-995d-5f758ab5a125): created successfully Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e84cd1-e28d-40fe-a74a-dff8cf929920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (7e6a6f9a-5cc8-4ecf-a017-d81e51efd89b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:19 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" returned: 0 in 0.369s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:19 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-eb06d0cc-176b-4798-8e30-0d3f0721762c tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created volume successfully. Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-quobyte-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d" released by "delete_volume" :: held 0.994s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Created reservations ['06cbfd5d-cfb0-463b-b288-d82dd0a3ce00', 'bef3d692-5442-480c-b048-812e6656f85b', 'bbff2c81-b122-4d4f-8c5a-da8a6d365a4c', '1cc72803-8ded-4d94-ac6f-ff6f3f1d2866'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:19 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:19 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:19 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20" returned: 0 in 0.497s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:19 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20 Nov 04 19:12:19 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:19 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:19 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.292s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d 1073741824" returned: 0 in 0.605s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:19 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Deleted volume successfully. Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-02551bfb-0026-4c40-8b6e-bf17ec74be31 tempest-VolumeDependencyTests-1712848092 None] Lock "cinder-adce3cf1-6a1a-40a2-b894-e4093ecb7d5d-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:19 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4.947b2683-0c5e-49ab-b46f-2fdf57dd8c20" returned: 0 in 0.319s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:19 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d Nov 04 19:12:19 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-947b2683-0c5e-49ab-b46f-2fdf57dd8c20" released by "_delete_snapshot" :: held 1.921s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-61252b3d-8583-4733-a6cd-970cdc6d7aa4" released by "delete_snapshot" :: held 1.947s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Created reservations ['17f1290e-5ee4-4a8e-8e81-983b362b57f7', '1532760a-2351-4176-8335-49fe1b1dbf06', '02222213-3274-47f9-9737-f66756da1364', 'e398e1b5-f3f0-4c3f-86a5-d7be8beb9bcc'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:19 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Delete snapshot completed successfully. Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d6628ea4-96ab-4e2c-bc1c-28c72ae3ff11 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-947b2683-0c5e-49ab-b46f-2fdf57dd8c20-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:19 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d" returned: 0 in 0.294s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.605s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097598294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa156b3-ccf0-42b4-8717-e82dd36c16b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:16Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Creating volume 3fa156b3-ccf0-42b4-8717-e82dd36c16b4 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:20 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca01bf39-6140-4ce0-9f1f-91364d2b75da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d8d0b7-0421-4410-98af-b2f8dccf659d', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:20 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4 1073741824 Nov 04 19:12:20 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12d8f2c-df10-4e8c-a3fe-841de1c63816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-61252b3d-8583-4733-a6cd-970cdc6d7aa4-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:20 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume volume-45d8d0b7-0421-4410-98af-b2f8dccf659d (45d8d0b7-0421-4410-98af-b2f8dccf659d): created successfully Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12d8f2c-df10-4e8c-a3fe-841de1c63816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (4dacb9ab-b2a3-4765-b311-e8fa25f5e22c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-61252b3d-8583-4733-a6cd-970cdc6d7aa4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:20 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-fe3ecc91-daaa-4308-a242-7533712b59c8 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created volume successfully. Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-61252b3d-8583-4733-a6cd-970cdc6d7aa4" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-61252b3d-8583-4733-a6cd-970cdc6d7aa4" acquired by "delete_volume" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[45182530-0702-492d-b686-dfce6b8a1be6]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:20 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 Nov 04 19:12:20 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:20 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4 1073741824" returned: 0 in 0.639s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (19fc4c7b-aabd-46f5-9a0a-f3bd416c90ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec7a562-b474-415d-b813-47b40fb2ebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec7a562-b474-415d-b813-47b40fb2ebd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-110049812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572c4a14-f5bc-46a1-ab61-5ac66698a066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:21Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be5225d-678c-4d97-870c-b4915bfe35f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be5225d-678c-4d97-870c-b4915bfe35f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798bbc7c-49df-4f8c-b3f3-c6b2fc678adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798bbc7c-49df-4f8c-b3f3-c6b2fc678adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572c4a14-f5bc-46a1-ab61-5ac66698a066', 'volume_name': 'volume-572c4a14-f5bc-46a1-ab61-5ac66698a066', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4906de9-7f6b-4961-a683-28753a858d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4906de9-7f6b-4961-a683-28753a858d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab3980f-24aa-4b6d-a671-a9d876fa436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:20 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Volume 572c4a14-f5bc-46a1-ab61-5ac66698a066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572c4a14-f5bc-46a1-ab61-5ac66698a066', 'volume_size': 1} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:20 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4" returned: 0 in 0.528s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:20 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4 Nov 04 19:12:20 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:20 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4 Nov 04 19:12:20 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:21 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4" returned: 0 in 0.262s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.969s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1740596864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87141338-57ef-4e60-98d9-ca52214bd73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec02a96c7f240ca923657a6da5e79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:17Z,use_quota=True,user_id='377c4d5dc20d4f0ab3c3824609518c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Creating volume 87141338-57ef-4e60-98d9-ca52214bd73e {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:21 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:21 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:21 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e 1073741824 Nov 04 19:12:21 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7252334-58be-4007-ba93-6251ead4359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ccd53cf-7896-41f9-8052-d426c5d1cd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-61252b3d-8583-4733-a6cd-970cdc6d7aa4" returned: 0 in 0.304s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-61252b3d-8583-4733-a6cd-970cdc6d7aa4" released by "delete_volume" :: held 0.934s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:21 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4 (3fa156b3-ccf0-42b4-8717-e82dd36c16b4): created successfully Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ccd53cf-7896-41f9-8052-d426c5d1cd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (a8dd7c05-ba68-4e06-9cb6-28cae5c37014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:21 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-964098cb-982d-4aa8-a69e-8588130a2eeb tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created volume successfully. Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Created reservations ['3b99601f-ef92-45c3-b030-53ec76ae2045', '135e0072-f7a8-4413-8db2-bab217f305d6', 'd19a6800-706c-4a03-911f-0f233dd1e9e9', 'eec4ee2f-6ebd-448d-b26e-8722d3f2d93a'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:21 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:21 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:21 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.286s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:21 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Deleted volume successfully. Nov 04 19:12:21 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e 1073741824" returned: 0 in 0.579s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-54c218ce-2915-440b-95e5-f9f80c63e2c8 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-61252b3d-8583-4733-a6cd-970cdc6d7aa4-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:21 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e Nov 04 19:12:21 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:21 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e" returned: 0 in 0.292s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.202s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-110049812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572c4a14-f5bc-46a1-ab61-5ac66698a066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:21Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Creating volume 572c4a14-f5bc-46a1-ab61-5ac66698a066 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:21 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cd8644-f0b6-4b11-bb47-fbbf72e9b96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87141338-57ef-4e60-98d9-ca52214bd73e', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:22 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 1073741824 Nov 04 19:12:22 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5596c205-5406-40a3-8832-d698a72cf3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:22 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Volume volume-87141338-57ef-4e60-98d9-ca52214bd73e (87141338-57ef-4e60-98d9-ca52214bd73e): created successfully Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5596c205-5406-40a3-8832-d698a72cf3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Flow 'volume_create_manager' (b5cbfbdf-852c-4c7e-b80a-97b7c4b75067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:22 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-14e55210-a443-4300-b7ea-db8fbd1f2924 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created volume successfully. Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-87141338-57ef-4e60-98d9-ca52214bd73e-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-87141338-57ef-4e60-98d9-ca52214bd73e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-quobyte-87141338-57ef-4e60-98d9-ca52214bd73e" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-87141338-57ef-4e60-98d9-ca52214bd73e" acquired by "delete_volume" :: waited 0.033s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4917cf74-8685-42cb-a120-2606ae30d27c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:22 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 1073741824" returned: 0 in 0.635s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:22 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 Nov 04 19:12:22 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:22 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e Nov 04 19:12:22 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:23 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Flow 'volume_create_manager' (09772337-4337-45d5-8bf3-e2ef32c2b9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ca64c4-c8cd-42db-ab4b-ecee52f59244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066" returned: 0 in 0.412s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ca64c4-c8cd-42db-ab4b-ecee52f59244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1724170359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8039e0-fc28-4041-a01f-d455e49b0788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a301738da044da8c7d8237afd4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:23Z,use_quota=True,user_id='9d535f9167674e209771286d2fb6c797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:23 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4823d6-5868-4140-866a-09e8557b5599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4823d6-5868-4140-866a-09e8557b5599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e1aa9e-5373-4f15-9bd8-342ca3834cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e1aa9e-5373-4f15-9bd8-342ca3834cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a8039e0-fc28-4041-a01f-d455e49b0788', 'volume_name': 'volume-4a8039e0-fc28-4041-a01f-d455e49b0788', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bae4692-a50c-4d5a-9de1-7846e73a41b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bae4692-a50c-4d5a-9de1-7846e73a41b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f473fae9-b1d2-4e7b-88bc-54c667a81990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:23 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Volume 4a8039e0-fc28-4041-a01f-d455e49b0788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a8039e0-fc28-4041-a01f-d455e49b0788', 'volume_size': 1} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1724170359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8039e0-fc28-4041-a01f-d455e49b0788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a301738da044da8c7d8237afd4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:23Z,use_quota=True,user_id='9d535f9167674e209771286d2fb6c797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Creating volume 4a8039e0-fc28-4041-a01f-d455e49b0788 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:23 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab3980f-24aa-4b6d-a671-a9d876fa436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572c4a14-f5bc-46a1-ab61-5ac66698a066', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:23 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 1073741824 Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae63974-3fbe-49bf-87be-1c4f599ac1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:23 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e" returned: 0 in 0.648s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:23 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Volume volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 (572c4a14-f5bc-46a1-ab61-5ac66698a066): created successfully Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae63974-3fbe-49bf-87be-1c4f599ac1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:23 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e Nov 04 19:12:23 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (19fc4c7b-aabd-46f5-9a0a-f3bd416c90ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:23 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0fe05b2f-3c18-4ee5-b058-4dc4e6598de0 tempest-ProjectMemberTests-4201210 None] Created volume successfully. Nov 04 19:12:23 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-87141338-57ef-4e60-98d9-ca52214bd73e" returned: 0 in 0.310s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-87141338-57ef-4e60-98d9-ca52214bd73e" released by "delete_volume" :: held 1.031s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created reservations ['d4d662d5-bd69-4033-8122-2446d629051c', '172d7fa6-b067-4cb8-96c3-6d94e2992c04', '3ea37286-5194-452f-89b4-20c632482b96', 'f02d2727-4749-48c3-81f2-0b1d0cd6b282'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:23 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 1073741824" returned: 0 in 0.555s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:23 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:23 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:23 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 Nov 04 19:12:23 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:24 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.330s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Deleted volume successfully. Nov 04 19:12:24 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788" returned: 0 in 0.315s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-bcdc5c95-0503-41da-9449-3e221bd1c6e5 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-87141338-57ef-4e60-98d9-ca52214bd73e-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f473fae9-b1d2-4e7b-88bc-54c667a81990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a8039e0-fc28-4041-a01f-d455e49b0788', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a86acb-81a8-4465-812d-aec24cfaf065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:24 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Volume volume-4a8039e0-fc28-4041-a01f-d455e49b0788 (4a8039e0-fc28-4041-a01f-d455e49b0788): created successfully Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a86acb-81a8-4465-812d-aec24cfaf065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Flow 'volume_create_manager' (09772337-4337-45d5-8bf3-e2ef32c2b9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3eb8e506-390e-413b-a332-b5c26a51a9d6 tempest-ProjectReaderTests-1979060275 None] Created volume successfully. Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] Creating offline snapshot 2289612c-1ca6-42fd-a5a8-7d000763c91a of volume 572c4a14-f5bc-46a1-ab61-5ac66698a066 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fb0a7d-73df-4ca3-a960-7bdab6287bbc]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:24 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 Nov 04 19:12:24 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Flow 'volume_create_manager' (c965dcc4-8109-45e2-abee-472c11aab4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb591f12-4a61-4e3f-aca9-07b2e6e12ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-3fa156b3-ccf0-42b4-8717-e82dd36c16b4-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb591f12-4a61-4e3f-aca9-07b2e6e12ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840673491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae1516a-eec4-4d84-a930-82611e3d447e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87d1bd8260d44f7a04074c41b2cd937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:25Z,use_quota=True,user_id='2dc089ba48fe47ec88101cad95643105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f61927-74f5-46fd-b703-6b638af31fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f61927-74f5-46fd-b703-6b638af31fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6e9def-3ee1-41f8-a4c9-bec01bb5427b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6e9def-3ee1-41f8-a4c9-bec01bb5427b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae1516a-eec4-4d84-a930-82611e3d447e', 'volume_name': 'volume-eae1516a-eec4-4d84-a930-82611e3d447e', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b56a32-16b2-45c5-af88-d43e8c31150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b56a32-16b2-45c5-af88-d43e8c31150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73bc17c-f777-4737-9298-debfae82469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:24 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Volume eae1516a-eec4-4d84-a930-82611e3d447e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae1516a-eec4-4d84-a930-82611e3d447e', 'volume_size': 1} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-3fa156b3-ccf0-42b4-8717-e82dd36c16b4-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-quobyte-3fa156b3-ccf0-42b4-8717-e82dd36c16b4" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:24 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066" returned: 0 in 0.427s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-3fa156b3-ccf0-42b4-8717-e82dd36c16b4" acquired by "delete_volume" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:24 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a 1G Nov 04 19:12:24 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[23326000-c837-4924-9478-4fa7dc1542ce]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:25 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4 Nov 04 19:12:25 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:25 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4" returned: 0 in 0.409s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:25 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4 Nov 04 19:12:25 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:25 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a 1G" returned: 0 in 0.525s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:25 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a Nov 04 19:12:25 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:25 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-3fa156b3-ccf0-42b4-8717-e82dd36c16b4" returned: 0 in 0.252s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-3fa156b3-ccf0-42b4-8717-e82dd36c16b4" released by "delete_volume" :: held 0.716s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created reservations ['89064631-a122-4471-bdb0-54d66599e8ee', 'a58f9fc4-48c4-4d6a-962e-5962c685d520', 'e3d92c2e-81c3-41b0-a476-67fad599cfe2', 'e1a4ac6c-fa99-4986-bd44-f4798c72811e'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:25 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a" returned: 0 in 0.318s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:25 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a is being set with open permissions: ugo+rw Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:25 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a Nov 04 19:12:25 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:25 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:25 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-45d8d0b7-0421-4410-98af-b2f8dccf659d-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-45d8d0b7-0421-4410-98af-b2f8dccf659d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-quobyte-45d8d0b7-0421-4410-98af-b2f8dccf659d" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-45d8d0b7-0421-4410-98af-b2f8dccf659d" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:26 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a" returned: 0 in 0.317s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3445d79c-71c7-435f-918b-3bb5541e3f7d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:26 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.298s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:26 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Deleted volume successfully. Nov 04 19:12:26 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.info Nov 04 19:12:26 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3d9c8032-fd5e-47b5-89e4-d94114abdbe6 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-3fa156b3-ccf0-42b4-8717-e82dd36c16b4-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:26 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d Nov 04 19:12:26 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:26 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.info" returned: 0 in 0.274s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:26 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.info is being set with open permissions: ugo+rw Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:26 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.info Nov 04 19:12:26 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:26 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d" returned: 0 in 0.416s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:26 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d Nov 04 19:12:26 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:26 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.info" returned: 0 in 0.247s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.809s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840673491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae1516a-eec4-4d84-a930-82611e3d447e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87d1bd8260d44f7a04074c41b2cd937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:25Z,use_quota=True,user_id='2dc089ba48fe47ec88101cad95643105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Creating volume eae1516a-eec4-4d84-a930-82611e3d447e {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:26 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:26 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e 1073741824 Nov 04 19:12:26 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:26 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ec4f0700-2ea3-41f8-ac5d-3158dec55bb7 tempest-ProjectMemberTests-4201210 None] Create snapshot completed successfully Nov 04 19:12:26 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-45d8d0b7-0421-4410-98af-b2f8dccf659d" returned: 0 in 0.276s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-45d8d0b7-0421-4410-98af-b2f8dccf659d" released by "delete_volume" :: held 0.750s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created reservations ['e556e3b0-2ad2-4966-a185-bbc4fdf6198f', '7dabdac7-12e2-4cad-95fe-12e056ecbd39', '765d6c4f-c52b-4004-b144-5243edf1bf21', 'b651596a-efcb-4e08-bc0f-88bbfe151461'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:26 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:26 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-afec1b76-25c3-43fd-995d-5f758ab5a125-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-afec1b76-25c3-43fd-995d-5f758ab5a125-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:27 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.323s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:27 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-quobyte-afec1b76-25c3-43fd-995d-5f758ab5a125" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e 1073741824" returned: 0 in 0.566s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:27 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Deleted volume successfully. Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-afec1b76-25c3-43fd-995d-5f758ab5a125" acquired by "delete_volume" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5186ffc5-3ffb-4689-b99e-3da4e37ad14d tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-45d8d0b7-0421-4410-98af-b2f8dccf659d-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a98fd13-8bf1-4ea2-b60d-5e35036ace55]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:27 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e Nov 04 19:12:27 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:27 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125 Nov 04 19:12:27 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-2289612c-1ca6-42fd-a5a8-7d000763c91a-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Lock "cinder-2289612c-1ca6-42fd-a5a8-7d000763c91a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-572c4a14-f5bc-46a1-ab61-5ac66698a066" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-572c4a14-f5bc-46a1-ab61-5ac66698a066" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-2289612c-1ca6-42fd-a5a8-7d000763c91a" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-2289612c-1ca6-42fd-a5a8-7d000763c91a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Deleting offline snapshot 2289612c-1ca6-42fd-a5a8-7d000763c91a of volume 572c4a14-f5bc-46a1-ab61-5ac66698a066 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] snapshot_file for this snap is: volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b967d57-6103-4bce-bdba-53dbc06e001f]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:27 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e" returned: 0 in 0.320s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.356s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] Creating offline snapshot 2608556c-bda9-40d1-ab39-34a4c55bf795 of volume 4a8039e0-fc28-4041-a01f-d455e49b0788 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73bc17c-f777-4737-9298-debfae82469c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae1516a-eec4-4d84-a930-82611e3d447e', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01adcad-ab99-4de1-938a-4d658cd113d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[874cc297-0b7f-4dd4-a4e6-651cb15981fb]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:27 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Volume volume-eae1516a-eec4-4d84-a930-82611e3d447e (eae1516a-eec4-4d84-a930-82611e3d447e): created successfully Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01adcad-ab99-4de1-938a-4d658cd113d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Flow 'volume_create_manager' (c965dcc4-8109-45e2-abee-472c11aab4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:27 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ac86c25f-1b46-49f8-b086-ac4de444e631 tempest-ProjectReaderTests-1626011482 None] Created volume successfully. Nov 04 19:12:27 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a Nov 04 19:12:27 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:27 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125" returned: 0 in 0.497s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:27 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125 Nov 04 19:12:27 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:27 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 Nov 04 19:12:27 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:28 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a" returned: 0 in 0.437s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-572c4a14-f5bc-46a1-ab61-5ac66698a066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[59396223-4f4e-49e8-bc7d-28fa170c060b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:28 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-afec1b76-25c3-43fd-995d-5f758ab5a125" returned: 0 in 0.317s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-afec1b76-25c3-43fd-995d-5f758ab5a125" released by "delete_volume" :: held 0.874s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:28 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788" returned: 0 in 0.464s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:28 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 1G Nov 04 19:12:28 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:28 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 Nov 04 19:12:28 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created reservations ['e35c86ba-fe1c-4d98-9eb9-8f705bdd01ea', 'fd9888b7-c662-450d-899e-b5a2b1302dd7', 'b5166c09-d291-4cb2-8412-33d9453dc29d', '1d543d65-2158-41ac-8111-d7828072d588'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:28 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:28 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:28 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066" returned: 0 in 0.428s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:28 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a Nov 04 19:12:28 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:28 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 1G" returned: 0 in 0.530s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a8039e0-fc28-4041-a01f-d455e49b0788 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:28 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a8039e0-fc28-4041-a01f-d455e49b0788 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 Nov 04 19:12:28 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:28 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.334s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:28 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Deleted volume successfully. Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-239bab21-5420-4bb8-a1ee-72eb82822813 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-afec1b76-25c3-43fd-995d-5f758ab5a125-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:28 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a" returned: 0 in 0.420s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:29 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a Nov 04 19:12:29 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:29 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a8039e0-fc28-4041-a01f-d455e49b0788 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795" returned: 0 in 0.353s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:29 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 is being set with open permissions: ugo+rw Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:29 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 Nov 04 19:12:29 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Acquiring lock "cinder-eae1516a-eec4-4d84-a930-82611e3d447e-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Lock "cinder-eae1516a-eec4-4d84-a930-82611e3d447e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Acquiring lock "cinder-quobyte-eae1516a-eec4-4d84-a930-82611e3d447e" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:29 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Lock "cinder-quobyte-eae1516a-eec4-4d84-a930-82611e3d447e" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066.2289612c-1ca6-42fd-a5a8-7d000763c91a" returned: 0 in 0.315s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c50945-19cf-4d47-8caa-00b9cc7ffdda]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-2289612c-1ca6-42fd-a5a8-7d000763c91a" released by "_delete_snapshot" :: held 1.757s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:29 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-572c4a14-f5bc-46a1-ab61-5ac66698a066" released by "delete_snapshot" :: held 1.794s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795" returned: 0 in 0.297s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:29 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.info Nov 04 19:12:29 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:29 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e Nov 04 19:12:29 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Created reservations ['cbfd28f9-a7de-4fed-aaa7-a8a8acbb3e9d', 'f5452aee-0b34-4006-93c1-9fb5cfd0844f', 'dbdb8e60-952b-444d-8510-6710ef2d1c2c', '198a39a5-7e1e-4ccc-864b-b66dfc76b188'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-quobyte-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:29 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Delete snapshot completed successfully. Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31" acquired by "delete_volume" :: waited 0.044s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-73c7715e-888e-471d-9b1a-f712169a343b tempest-ProjectMemberTests-4201210 None] Lock "cinder-2289612c-1ca6-42fd-a5a8-7d000763c91a-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7825b1-e4c0-4509-b4dc-29bd4e964f3c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-572c4a14-f5bc-46a1-ab61-5ac66698a066-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Lock "cinder-572c4a14-f5bc-46a1-ab61-5ac66698a066-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:29 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.info" returned: 0 in 0.438s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:29 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.info is being set with open permissions: ugo+rw Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:29 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:29 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31 Nov 04 19:12:29 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:29 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.info Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e" returned: 0 in 0.555s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:29 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-572c4a14-f5bc-46a1-ab61-5ac66698a066" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:29 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-572c4a14-f5bc-46a1-ab61-5ac66698a066" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:29 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe598ac-2813-4ab8-8926-5ccb7d32267e]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:30 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 Nov 04 19:12:30 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:30 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.info" returned: 0 in 0.315s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.526s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:30 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:30 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31" returned: 0 in 0.517s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eae1516a-eec4-4d84-a930-82611e3d447e" returned: 0 in 0.343s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:30 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31 Nov 04 19:12:30 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Lock "cinder-quobyte-eae1516a-eec4-4d84-a930-82611e3d447e" released by "delete_volume" :: held 0.982s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:30 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3b2143ce-c0fe-4724-82da-aea72e113d0b tempest-ProjectReaderTests-1979060275 None] Create snapshot completed successfully Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Created reservations ['93414a86-6ed0-458d-a1ca-27c20ff60f1d', '6ab69994-f193-4a23-a7ee-d931c21bcf09', '39731297-fc8d-4eae-bfa3-d12366332758', 'aa1f033e-54a1-459b-a765-08083d29a7e1'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:30 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066" returned: 0 in 0.449s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:30 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066 Nov 04 19:12:30 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:30 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:30 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:30 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31" returned: 0 in 0.371s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31" released by "delete_volume" :: held 0.966s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-2608556c-bda9-40d1-ab39-34a4c55bf795-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Lock "cinder-2608556c-bda9-40d1-ab39-34a4c55bf795-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-4a8039e0-fc28-4041-a01f-d455e49b0788" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-4a8039e0-fc28-4041-a01f-d455e49b0788" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-2608556c-bda9-40d1-ab39-34a4c55bf795" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created reservations ['977199e7-d523-4ca7-b950-fb3cd8ec3418', '2c8a181f-2f8d-4fff-bab7-40932b88e06c', '89c4e660-2812-4da4-a32d-6e3b340b1f22', '94214769-a882-4580-828b-50ac53188f8c'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-2608556c-bda9-40d1-ab39-34a4c55bf795" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Deleting offline snapshot 2608556c-bda9-40d1-ab39-34a4c55bf795 of volume 4a8039e0-fc28-4041-a01f-d455e49b0788 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] snapshot_file for this snap is: volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fc5a97-b388-4f65-933d-0445ad209f71]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:30 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:30 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-572c4a14-f5bc-46a1-ab61-5ac66698a066" returned: 0 in 0.433s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.385s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-572c4a14-f5bc-46a1-ab61-5ac66698a066" released by "delete_volume" :: held 1.006s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:30 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Deleted volume successfully. Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:30 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 Nov 04 19:12:30 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:31 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:31 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f260ed50-e14f-4e3d-abbc-06295ac2e55e tempest-ProjectReaderTests-1626011482 None] Lock "cinder-eae1516a-eec4-4d84-a930-82611e3d447e-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Created reservations ['e7efdc80-8e0a-4dee-b375-87b0e83ca869', '1d4e77c4-9a36-4bde-a1c1-76a0912037f2', '1bfd67e7-b85e-426c-876e-d3c08f8f7de8', '1a97d741-f449-4587-890c-c11d2ee4878c'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:31 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:31 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:31 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795" returned: 0 in 0.445s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a8039e0-fc28-4041-a01f-d455e49b0788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda3e853-21c9-46b7-a1c3-5698367945d4]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:31 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.357s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:31 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Deleted volume successfully. Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-586beb1a-1ed1-41f2-b132-3bc36b28874f tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-7a8fb6d0-5ef5-49dc-aaf7-d0674796bb31-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:31 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 Nov 04 19:12:31 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:31 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.330s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:31 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Deleted volume successfully. Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57cf8a57-9b49-44b1-8cce-cd9f842413cb tempest-ProjectMemberTests-4201210 None] Lock "cinder-572c4a14-f5bc-46a1-ab61-5ac66698a066-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:31 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788" returned: 0 in 0.468s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-eac48f0e-d53f-488a-ad42-0ccb8b94e41b-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:31 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 Nov 04 19:12:31 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-eac48f0e-d53f-488a-ad42-0ccb8b94e41b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "cinder-quobyte-eac48f0e-d53f-488a-ad42-0ccb8b94e41b" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-eac48f0e-d53f-488a-ad42-0ccb8b94e41b" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[141cad42-b3a7-4eaf-8a55-1fc89f00e2cc]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Flow 'volume_create_manager' (ecbc0255-dd71-4548-8145-09aa300ce87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c723a0ce-097b-4491-bf41-fe37ae1561a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c723a0ce-097b-4491-bf41-fe37ae1561a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001656441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb1d6df-dcf2-434e-a300-31d031dcf471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87d1bd8260d44f7a04074c41b2cd937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:32Z,use_quota=True,user_id='2dc089ba48fe47ec88101cad95643105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4b3f76-e08e-4c32-a5e6-d0b194fa26ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4b3f76-e08e-4c32-a5e6-d0b194fa26ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd23c917-9691-412f-ab93-9812cf8ce521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd23c917-9691-412f-ab93-9812cf8ce521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb1d6df-dcf2-434e-a300-31d031dcf471', 'volume_name': 'volume-5eb1d6df-dcf2-434e-a300-31d031dcf471', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f25820e-0915-40a3-90e7-0df7ac9005dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f25820e-0915-40a3-90e7-0df7ac9005dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82792885-01a3-42c0-99b3-525f59e8867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:32 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Volume 5eb1d6df-dcf2-434e-a300-31d031dcf471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb1d6df-dcf2-434e-a300-31d031dcf471', 'volume_size': 1} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001656441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb1d6df-dcf2-434e-a300-31d031dcf471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87d1bd8260d44f7a04074c41b2cd937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:32Z,use_quota=True,user_id='2dc089ba48fe47ec88101cad95643105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Creating volume 5eb1d6df-dcf2-434e-a300-31d031dcf471 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:32 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:32 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b Nov 04 19:12:32 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:32 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471 1073741824 Nov 04 19:12:32 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:32 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795" returned: 0 in 0.521s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:32 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795 Nov 04 19:12:32 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:32 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b" returned: 0 in 0.512s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:32 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b Nov 04 19:12:32 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=251,cinder:UPDATE=328,cinder:DELETE=29,cinder:INSERT=83 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:UPDATE=317,cinder:SELECT=230,cinder:INSERT=89,cinder:DELETE=29 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:32 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (8a71ef4b-8021-48bd-8662-7c489f72a4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c155d97a-c56f-4cab-88b7-729d44a08e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788.2608556c-bda9-40d1-ab39-34a4c55bf795" returned: 0 in 0.372s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c155d97a-c56f-4cab-88b7-729d44a08e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823870658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1188f5c2-a6f5-4106-8969-145c232f86c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:33Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7be1ad-75ec-4ee5-a71e-943da749307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:32 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7be1ad-75ec-4ee5-a71e-943da749307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741452aa-59fb-4fea-b513-cfc56e9ef011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741452aa-59fb-4fea-b513-cfc56e9ef011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1188f5c2-a6f5-4106-8969-145c232f86c7', 'volume_name': 'volume-1188f5c2-a6f5-4106-8969-145c232f86c7', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0f61e8-3d46-467b-a2eb-0322b38bc637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0f61e8-3d46-467b-a2eb-0322b38bc637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84f5229-dd10-48b5-91b9-b0d49686ca8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:32 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Volume 1188f5c2-a6f5-4106-8969-145c232f86c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1188f5c2-a6f5-4106-8969-145c232f86c7', 'volume_size': 1} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-2608556c-bda9-40d1-ab39-34a4c55bf795" released by "_delete_snapshot" :: held 2.017s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471 1073741824" returned: 0 in 0.663s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-4a8039e0-fc28-4041-a01f-d455e49b0788" released by "delete_snapshot" :: held 2.076s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:32 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-eac48f0e-d53f-488a-ad42-0ccb8b94e41b" returned: 0 in 0.348s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:32 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471 Nov 04 19:12:32 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-quobyte-eac48f0e-d53f-488a-ad42-0ccb8b94e41b" released by "delete_volume" :: held 0.943s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Created reservations ['2cf71157-f336-46d0-871e-12c17636f34e', '65d828ed-0f92-43c9-acba-103bdd643f77', 'a4db371f-85fa-441f-aafc-f13e956b0ea4', '8156bb96-915b-4599-a2d7-d6956dc9e451'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:32 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Created reservations ['8cadc3fb-0bab-42b5-b7fb-a1dd84b64b27', 'cce725a3-8521-4730-be43-b2f210d62718', 'c9d9b6b5-8d49-4654-b6ec-4696ff9e180a', 'cd317823-188e-45c8-89ba-15310ca815c9'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Delete snapshot completed successfully. Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-91fc6e75-0399-4f49-bd44-06a764d4038c tempest-ProjectReaderTests-1979060275 None] Lock "cinder-2608556c-bda9-40d1-ab39-34a4c55bf795-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:33 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:33 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:33 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471" returned: 0 in 0.274s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823870658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1188f5c2-a6f5-4106-8969-145c232f86c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:33Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Creating volume 1188f5c2-a6f5-4106-8969-145c232f86c7 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:33 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82792885-01a3-42c0-99b3-525f59e8867a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb1d6df-dcf2-434e-a300-31d031dcf471', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:33 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 1073741824 Nov 04 19:12:33 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb63c03-83c7-4532-abad-3169a29497b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:33 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Volume volume-5eb1d6df-dcf2-434e-a300-31d031dcf471 (5eb1d6df-dcf2-434e-a300-31d031dcf471): created successfully Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb63c03-83c7-4532-abad-3169a29497b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Flow 'volume_create_manager' (ecbc0255-dd71-4548-8145-09aa300ce87c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-74f9a29e-191c-4ca1-bed1-e61db9651296 tempest-ProjectReaderTests-1626011482 None] Created volume successfully. Nov 04 19:12:33 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.305s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Deleted volume successfully. Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7e83f0e6-5e25-46be-8044-de1896e2a398 tempest-CreateVolumesFromSourceVolumeTest-392664314 None] Lock "cinder-eac48f0e-d53f-488a-ad42-0ccb8b94e41b-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:33 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 1073741824" returned: 0 in 0.465s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:33 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 Nov 04 19:12:33 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-4a8039e0-fc28-4041-a01f-d455e49b0788-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:33 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7" returned: 0 in 0.299s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f84f5229-dd10-48b5-91b9-b0d49686ca8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1188f5c2-a6f5-4106-8969-145c232f86c7', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830d9a73-3027-4c69-9c57-5d46b7d534e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-4a8039e0-fc28-4041-a01f-d455e49b0788-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:34 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Volume volume-1188f5c2-a6f5-4106-8969-145c232f86c7 (1188f5c2-a6f5-4106-8969-145c232f86c7): created successfully Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830d9a73-3027-4c69-9c57-5d46b7d534e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (8a71ef4b-8021-48bd-8662-7c489f72a4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:34 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-db233e7e-99cd-4725-9fb5-f3156884a613 tempest-ProjectMemberTests-4201210 None] Created volume successfully. Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-4a8039e0-fc28-4041-a01f-d455e49b0788" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-4a8039e0-fc28-4041-a01f-d455e49b0788" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Acquiring lock "cinder-5eb1d6df-dcf2-434e-a300-31d031dcf471-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e97013-8fe8-4d51-9276-9df534d16176]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Lock "cinder-5eb1d6df-dcf2-434e-a300-31d031dcf471-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Acquiring lock "cinder-quobyte-5eb1d6df-dcf2-434e-a300-31d031dcf471" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Lock "cinder-quobyte-5eb1d6df-dcf2-434e-a300-31d031dcf471" acquired by "delete_volume" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeac93d-a031-42a5-b231-52de31a86fd0]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:34 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 Nov 04 19:12:34 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:34 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471 Nov 04 19:12:34 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:34 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788" returned: 0 in 0.494s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:34 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788 Nov 04 19:12:34 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:34 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471" returned: 0 in 0.460s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:34 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471 Nov 04 19:12:34 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] Creating offline snapshot f6041e7f-f309-4523-ac6a-bcc56031b934 of volume 1188f5c2-a6f5-4106-8969-145c232f86c7 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[01020b46-5890-426b-8e9c-d53af0548bf9]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:35 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-4a8039e0-fc28-4041-a01f-d455e49b0788" returned: 0 in 0.382s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-4a8039e0-fc28-4041-a01f-d455e49b0788" released by "delete_volume" :: held 1.008s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:35 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 Nov 04 19:12:35 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:35 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Created reservations ['5a9f5bd5-ed57-4072-9670-0926cde65a8b', '524692d8-b078-4fcb-a3a5-141de2afc126', '5e3ce49d-8c1b-41e0-83a6-6acc87cddfb6', '9a65f7f4-0092-4539-886b-d53ed9bea417'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-5eb1d6df-dcf2-434e-a300-31d031dcf471" returned: 0 in 0.416s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Lock "cinder-quobyte-5eb1d6df-dcf2-434e-a300-31d031dcf471" released by "delete_volume" :: held 0.944s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:35 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:35 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Created reservations ['f10ae22e-e86a-4086-8ffa-995db7af9b70', 'b2556401-f0c0-4995-8d6c-9f339084636e', '0ed0daeb-9a45-42f2-91a0-df1b463ff722', '68bf0ea5-9127-4348-affa-6148f8ee5d8f'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:35 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7" returned: 0 in 0.575s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:35 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:35 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:35 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 1G Nov 04 19:12:35 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:35 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.330s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:35 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Deleted volume successfully. Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99ac7c82-eeb7-4aac-9cd4-2471387375e6 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-4a8039e0-fc28-4041-a01f-d455e49b0788-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:35 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.343s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:35 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Deleted volume successfully. Nov 04 19:12:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-6edcd48a-6d7e-47ad-8c03-1a2b5cb37b80 tempest-ProjectReaderTests-1626011482 None] Lock "cinder-5eb1d6df-dcf2-434e-a300-31d031dcf471-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:36 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 1G" returned: 0 in 0.555s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1188f5c2-a6f5-4106-8969-145c232f86c7 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:36 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1188f5c2-a6f5-4106-8969-145c232f86c7 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 Nov 04 19:12:36 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:36 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1188f5c2-a6f5-4106-8969-145c232f86c7 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934" returned: 0 in 0.423s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:36 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 is being set with open permissions: ugo+rw Nov 04 19:12:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:36 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 Nov 04 19:12:36 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:36 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934" returned: 0 in 0.373s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:36 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Flow 'volume_create_manager' (2e4a966b-e068-4520-9292-15746c0fa746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50292c6-595e-43b8-8a59-2db36cb1b70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:37 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.info Nov 04 19:12:37 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50292c6-595e-43b8-8a59-2db36cb1b70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-141818423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748f2871-6119-4eda-acaa-c65f47393d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a301738da044da8c7d8237afd4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:37Z,use_quota=True,user_id='9d535f9167674e209771286d2fb6c797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb2a9c2-1b80-4fe0-93f2-c76476068a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb2a9c2-1b80-4fe0-93f2-c76476068a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1035fb1c-b6c5-4d87-bb76-c84396ed219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1035fb1c-b6c5-4d87-bb76-c84396ed219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748f2871-6119-4eda-acaa-c65f47393d2f', 'volume_name': 'volume-748f2871-6119-4eda-acaa-c65f47393d2f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a513cd5c-3b70-45b4-9d25-2b960eaa863a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a513cd5c-3b70-45b4-9d25-2b960eaa863a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e0257a-3c55-4d0e-951c-9c8d63f1e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:37 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Volume 748f2871-6119-4eda-acaa-c65f47393d2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748f2871-6119-4eda-acaa-c65f47393d2f', 'volume_size': 1} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:37 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.info" returned: 0 in 0.290s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:37 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.info is being set with open permissions: ugo+rw Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:37 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.info Nov 04 19:12:37 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:37 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.info" returned: 0 in 0.249s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-141818423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748f2871-6119-4eda-acaa-c65f47393d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a301738da044da8c7d8237afd4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:37Z,use_quota=True,user_id='9d535f9167674e209771286d2fb6c797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Creating volume 748f2871-6119-4eda-acaa-c65f47393d2f {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:37 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:37 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f 1073741824 Nov 04 19:12:37 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-72a61e5f-6158-43bd-8782-4362a66b1761 tempest-ProjectMemberTests-4201210 None] Create snapshot completed successfully Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-f6041e7f-f309-4523-ac6a-bcc56031b934-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Lock "cinder-f6041e7f-f309-4523-ac6a-bcc56031b934-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-1188f5c2-a6f5-4106-8969-145c232f86c7" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-1188f5c2-a6f5-4106-8969-145c232f86c7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-f6041e7f-f309-4523-ac6a-bcc56031b934" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:38 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f 1073741824" returned: 0 in 0.583s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-f6041e7f-f309-4523-ac6a-bcc56031b934" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Deleting offline snapshot f6041e7f-f309-4523-ac6a-bcc56031b934 of volume 1188f5c2-a6f5-4106-8969-145c232f86c7 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] snapshot_file for this snap is: volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6b8a40-485e-4c2b-96f1-9e0e11f8cf17]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:38 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f Nov 04 19:12:38 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:38 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 Nov 04 19:12:38 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:38 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f" returned: 0 in 0.392s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e0257a-3c55-4d0e-951c-9c8d63f1e471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748f2871-6119-4eda-acaa-c65f47393d2f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ec09af-9f4d-4bbc-8da3-90c7ab9ed7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:38 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Volume volume-748f2871-6119-4eda-acaa-c65f47393d2f (748f2871-6119-4eda-acaa-c65f47393d2f): created successfully Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ec09af-9f4d-4bbc-8da3-90c7ab9ed7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Flow 'volume_create_manager' (2e4a966b-e068-4520-9292-15746c0fa746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:38 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934" returned: 0 in 0.527s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1188f5c2-a6f5-4106-8969-145c232f86c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:38 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a671399e-8c01-46cb-8098-0953c2e9bbec tempest-ProjectReaderTests-1979060275 None] Created volume successfully. Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[37245580-a46f-420c-9e8c-a4416fb9796f]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:38 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 Nov 04 19:12:38 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] Creating offline snapshot efe912bc-0346-42f2-a67e-059520ca886e of volume 748f2871-6119-4eda-acaa-c65f47393d2f {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[44862c05-9a87-4704-9afa-e695e00535e5]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:39 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7" returned: 0 in 0.483s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:39 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 Nov 04 19:12:39 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:39 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f Nov 04 19:12:39 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:39 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f" returned: 0 in 0.386s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:39 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934" returned: 0 in 0.381s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:39 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e 1G Nov 04 19:12:39 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:39 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934 Nov 04 19:12:39 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:39 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7.f6041e7f-f309-4523-ac6a-bcc56031b934" returned: 0 in 0.312s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-f6041e7f-f309-4523-ac6a-bcc56031b934" released by "_delete_snapshot" :: held 1.858s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-1188f5c2-a6f5-4106-8969-145c232f86c7" released by "delete_snapshot" :: held 1.896s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Created reservations ['c0f5cd42-d7c0-47a5-a6da-57aaf7d6c122', 'a8010eee-58ad-422c-9548-3822a41af208', '36ea6bbd-160b-4e13-b5ba-f9b11d55e0f8', 'bb82e4d6-2fdd-44f2-965e-039b6aefc666'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:40 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e 1G" returned: 0 in 0.522s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748f2871-6119-4eda-acaa-c65f47393d2f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:40 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Delete snapshot completed successfully. Nov 04 19:12:40 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748f2871-6119-4eda-acaa-c65f47393d2f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e Nov 04 19:12:40 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-57692cf6-3dd9-4d38-a4d6-2fbe909e14f2 tempest-ProjectMemberTests-4201210 None] Lock "cinder-f6041e7f-f309-4523-ac6a-bcc56031b934-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-1188f5c2-a6f5-4106-8969-145c232f86c7-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Lock "cinder-1188f5c2-a6f5-4106-8969-145c232f86c7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-1188f5c2-a6f5-4106-8969-145c232f86c7" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-1188f5c2-a6f5-4106-8969-145c232f86c7" acquired by "delete_volume" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:40 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748f2871-6119-4eda-acaa-c65f47393d2f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e" returned: 0 in 0.368s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:40 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e is being set with open permissions: ugo+rw Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7f625d-1f5b-4bab-b234-f0a630519f9d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:40 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e Nov 04 19:12:40 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:40 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 Nov 04 19:12:40 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:40 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e" returned: 0 in 0.272s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:40 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.info Nov 04 19:12:40 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:40 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7" returned: 0 in 0.417s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:40 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7 Nov 04 19:12:40 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:41 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.info" returned: 0 in 0.319s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:41 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.info is being set with open permissions: ugo+rw Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:41 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.info Nov 04 19:12:41 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:41 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-1188f5c2-a6f5-4106-8969-145c232f86c7" returned: 0 in 0.340s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-1188f5c2-a6f5-4106-8969-145c232f86c7" released by "delete_volume" :: held 0.859s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Created reservations ['57a82e59-4982-4057-863c-c210aa7cc306', 'f290f5c3-10ae-440b-95f9-6c913b8b9096', '0f76edad-fba8-4807-b8d2-cd29dc7251cb', '27d5c8ca-e270-42eb-ad7f-fb52e5310e07'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:41 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.info" returned: 0 in 0.300s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f154c1cc-314b-457f-95ce-6621ab335870 tempest-ProjectReaderTests-1979060275 None] Create snapshot completed successfully Nov 04 19:12:41 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:41 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:41 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.322s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:41 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Deleted volume successfully. Nov 04 19:12:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-974e7df5-e163-41a3-b562-b4b75aa827ff tempest-ProjectMemberTests-4201210 None] Lock "cinder-1188f5c2-a6f5-4106-8969-145c232f86c7-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (0c398ce6-9ab6-4812-8d19-2ab958e6b2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15224e1-7ef7-42fb-b55e-7be151ffac8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15224e1-7ef7-42fb-b55e-7be151ffac8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1940211772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b495c9-c72e-4c00-9862-1463b19c6b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:42Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d564927-6fee-4078-be4e-95edd07c369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d564927-6fee-4078-be4e-95edd07c369c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7969def-c077-424c-af71-772cd8d173eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7969def-c077-424c-af71-772cd8d173eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b495c9-c72e-4c00-9862-1463b19c6b13', 'volume_name': 'volume-47b495c9-c72e-4c00-9862-1463b19c6b13', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54707a3f-5f2e-49a8-8579-a0bc18b4b293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54707a3f-5f2e-49a8-8579-a0bc18b4b293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7515383-801a-4a1a-9ffe-9693c845f044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:42 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Volume 47b495c9-c72e-4c00-9862-1463b19c6b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b495c9-c72e-4c00-9862-1463b19c6b13', 'volume_size': 1} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1940211772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b495c9-c72e-4c00-9862-1463b19c6b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:42Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Creating volume 47b495c9-c72e-4c00-9862-1463b19c6b13 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:42 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:42 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 1073741824 Nov 04 19:12:42 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-efe912bc-0346-42f2-a67e-059520ca886e-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-efe912bc-0346-42f2-a67e-059520ca886e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-748f2871-6119-4eda-acaa-c65f47393d2f" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-748f2871-6119-4eda-acaa-c65f47393d2f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-efe912bc-0346-42f2-a67e-059520ca886e" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-efe912bc-0346-42f2-a67e-059520ca886e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Deleting offline snapshot efe912bc-0346-42f2-a67e-059520ca886e of volume 748f2871-6119-4eda-acaa-c65f47393d2f {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] snapshot_file for this snap is: volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e871bb-eae9-4615-bb37-d57b8aff499a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:42 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e Nov 04 19:12:42 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:42 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 1073741824" returned: 0 in 0.538s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:42 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 Nov 04 19:12:42 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:42 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e" returned: 0 in 0.443s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-748f2871-6119-4eda-acaa-c65f47393d2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[68840ac2-2439-44a3-aced-2f279eda835a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:43 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13" returned: 0 in 0.314s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7515383-801a-4a1a-9ffe-9693c845f044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b495c9-c72e-4c00-9862-1463b19c6b13', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd00905-c9ac-49c6-bfb2-bc0a734ba9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:43 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Volume volume-47b495c9-c72e-4c00-9862-1463b19c6b13 (47b495c9-c72e-4c00-9862-1463b19c6b13): created successfully Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd00905-c9ac-49c6-bfb2-bc0a734ba9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:43 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f Nov 04 19:12:43 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (0c398ce6-9ab6-4812-8d19-2ab958e6b2c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:43 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0f1810f6-284d-4304-906c-9ee8bc761bef tempest-ProjectMemberTests-4201210 None] Created volume successfully. Nov 04 19:12:43 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f" returned: 0 in 0.406s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:43 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e Nov 04 19:12:43 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:43 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e" returned: 0 in 0.360s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:43 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:43 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e Nov 04 19:12:43 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:44 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f.efe912bc-0346-42f2-a67e-059520ca886e" returned: 0 in 0.268s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-efe912bc-0346-42f2-a67e-059520ca886e" released by "_delete_snapshot" :: held 1.603s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-748f2871-6119-4eda-acaa-c65f47393d2f" released by "delete_snapshot" :: held 1.641s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Created reservations ['bebc994e-8429-4aad-8ec2-a6f32d310390', 'b96685d2-775e-410a-ae22-0a2d698c7af9', '1b24b3d3-9db8-4ee4-91e4-ee340f8c81a9', 'f2862563-4375-409c-8f84-e12ac78e9964'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:44 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Delete snapshot completed successfully. Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-1da54f00-243b-4229-b071-8471f36822c5 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-efe912bc-0346-42f2-a67e-059520ca886e-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] Creating offline snapshot 3d3947d6-565b-445b-923e-de48841874d8 of volume 47b495c9-c72e-4c00-9862-1463b19c6b13 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcc62e7-7c7e-4c17-8ffe-77f249b5b075]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:44 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 Nov 04 19:12:44 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-748f2871-6119-4eda-acaa-c65f47393d2f-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-748f2871-6119-4eda-acaa-c65f47393d2f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-748f2871-6119-4eda-acaa-c65f47393d2f" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-748f2871-6119-4eda-acaa-c65f47393d2f" acquired by "delete_volume" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb68af7a-d2cc-4e6c-815a-cde4e69a234d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:44 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f Nov 04 19:12:44 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:44 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13" returned: 0 in 0.377s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:44 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:44 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 1G Nov 04 19:12:44 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:45 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f" returned: 0 in 0.379s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:45 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f Nov 04 19:12:45 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:45 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 1G" returned: 0 in 0.430s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b495c9-c72e-4c00-9862-1463b19c6b13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:45 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b495c9-c72e-4c00-9862-1463b19c6b13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 Nov 04 19:12:45 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:45 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-748f2871-6119-4eda-acaa-c65f47393d2f" returned: 0 in 0.273s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-748f2871-6119-4eda-acaa-c65f47393d2f" released by "delete_volume" :: held 0.728s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Created reservations ['8c58d702-cfaa-41cc-8612-fd9b154d931a', '6be40a63-4e72-4b07-8fcf-e9da5a19cad0', '32ef48a1-01cc-42ee-b0f5-ad5d287d912a', '08d3b180-1308-478c-a5f4-3c30973825c7'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:45 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:45 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:45 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b495c9-c72e-4c00-9862-1463b19c6b13 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8" returned: 0 in 0.351s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:45 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 is being set with open permissions: ugo+rw Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:45 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 Nov 04 19:12:45 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:45 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.318s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:45 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Deleted volume successfully. Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-847f28f4-2f45-4e15-ab24-4bf945eb7b75 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-748f2871-6119-4eda-acaa-c65f47393d2f-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:45 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:45 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8" returned: 0 in 0.354s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:46 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.info Nov 04 19:12:46 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:46 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.info" returned: 0 in 0.302s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:46 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.info is being set with open permissions: ugo+rw Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:46 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.info Nov 04 19:12:46 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Flow 'volume_create_manager' (2e587842-3620-4236-8347-6a5c78c3e3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd390e8-fff8-431f-ab24-7f4af1163ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd390e8-fff8-431f-ab24-7f4af1163ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5992783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f041181-6acd-4015-aee0-96707dbf922b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a301738da044da8c7d8237afd4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:46Z,use_quota=True,user_id='9d535f9167674e209771286d2fb6c797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829b9f21-560f-409c-bea8-1add4e3637e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829b9f21-560f-409c-bea8-1add4e3637e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619680d4-20b6-4be9-b31d-24423f57b545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619680d4-20b6-4be9-b31d-24423f57b545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f041181-6acd-4015-aee0-96707dbf922b', 'volume_name': 'volume-6f041181-6acd-4015-aee0-96707dbf922b', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d28a80-bf48-4710-9304-0442f86d7c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d28a80-bf48-4710-9304-0442f86d7c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6752f27-ed24-4fe3-b1e2-a04f2387fcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:46 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Volume 6f041181-6acd-4015-aee0-96707dbf922b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f041181-6acd-4015-aee0-96707dbf922b', 'volume_size': 1} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:46 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.info" returned: 0 in 0.277s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.069s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5992783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f041181-6acd-4015-aee0-96707dbf922b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a301738da044da8c7d8237afd4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:46Z,use_quota=True,user_id='9d535f9167674e209771286d2fb6c797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Creating volume 6f041181-6acd-4015-aee0-96707dbf922b {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:46 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:46 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:46 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b 1073741824 Nov 04 19:12:46 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:46 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-03502aa7-56af-45ab-bb0d-a141018c41e6 tempest-ProjectMemberTests-4201210 None] Create snapshot completed successfully Nov 04 19:12:47 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b 1073741824" returned: 0 in 0.404s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:47 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b Nov 04 19:12:47 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:47 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b" returned: 0 in 0.288s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6752f27-ed24-4fe3-b1e2-a04f2387fcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f041181-6acd-4015-aee0-96707dbf922b', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439c88af-53d3-4915-a27a-bcd2f1ae14b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:47 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Volume volume-6f041181-6acd-4015-aee0-96707dbf922b (6f041181-6acd-4015-aee0-96707dbf922b): created successfully Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439c88af-53d3-4915-a27a-bcd2f1ae14b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Flow 'volume_create_manager' (2e587842-3620-4236-8347-6a5c78c3e3b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:47 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2849f7ca-75a8-4149-a0a0-422a931c56f9 tempest-ProjectReaderTests-1979060275 None] Created volume successfully. Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-3d3947d6-565b-445b-923e-de48841874d8-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Lock "cinder-3d3947d6-565b-445b-923e-de48841874d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-47b495c9-c72e-4c00-9862-1463b19c6b13" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-47b495c9-c72e-4c00-9862-1463b19c6b13" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-3d3947d6-565b-445b-923e-de48841874d8" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-3d3947d6-565b-445b-923e-de48841874d8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Deleting offline snapshot 3d3947d6-565b-445b-923e-de48841874d8 of volume 47b495c9-c72e-4c00-9862-1463b19c6b13 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] snapshot_file for this snap is: volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c939a17-3201-4772-9a0c-cc972c449c97]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:47 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:47 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 Nov 04 19:12:47 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:48 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8" returned: 0 in 0.405s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47b495c9-c72e-4c00-9862-1463b19c6b13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b91017-686a-427b-ac73-bff7365fd916]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:48 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 Nov 04 19:12:48 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:48 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13" returned: 0 in 0.396s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] Creating offline snapshot e2ae62b7-730b-4424-a03c-42b1cdfd87f3 of volume 6f041181-6acd-4015-aee0-96707dbf922b {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:12:48 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 Nov 04 19:12:48 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c60dac-69a4-4bd8-9cf1-c1d102480412]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:48 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b Nov 04 19:12:48 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:48 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8" returned: 0 in 0.344s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:48 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:48 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8 Nov 04 19:12:48 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:49 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b" returned: 0 in 0.395s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:49 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 1G Nov 04 19:12:49 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:49 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13.3d3947d6-565b-445b-923e-de48841874d8" returned: 0 in 0.261s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-3d3947d6-565b-445b-923e-de48841874d8" released by "_delete_snapshot" :: held 1.525s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-47b495c9-c72e-4c00-9862-1463b19c6b13" released by "delete_snapshot" :: held 1.559s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Created reservations ['5d328bd3-1e31-43c7-afe5-8af17ee475ba', '876048a9-dcdd-4660-b54e-0a6d81e90006', '6481d829-bb54-4163-9553-86ef9866a058', '701ea302-1731-4f09-845c-b769decd3aaa'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:49 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Delete snapshot completed successfully. Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-50c73829-3262-4330-a3a0-2ea8496e35bc tempest-ProjectMemberTests-4201210 None] Lock "cinder-3d3947d6-565b-445b-923e-de48841874d8-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:49 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 1G" returned: 0 in 0.474s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f041181-6acd-4015-aee0-96707dbf922b -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:49 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f041181-6acd-4015-aee0-96707dbf922b -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 Nov 04 19:12:49 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-47b495c9-c72e-4c00-9862-1463b19c6b13-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Lock "cinder-47b495c9-c72e-4c00-9862-1463b19c6b13-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:49 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f041181-6acd-4015-aee0-96707dbf922b -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3" returned: 0 in 0.382s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:49 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 is being set with open permissions: ugo+rw Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:49 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 Nov 04 19:12:49 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-47b495c9-c72e-4c00-9862-1463b19c6b13" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-47b495c9-c72e-4c00-9862-1463b19c6b13" acquired by "delete_volume" :: waited 0.014s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2556c44f-d0b1-4140-aa48-569b1938318d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:49 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:50 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 Nov 04 19:12:50 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:50 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3" returned: 0 in 0.266s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:50 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.info Nov 04 19:12:50 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:50 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13" returned: 0 in 0.426s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:50 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13 Nov 04 19:12:50 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:50 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.info" returned: 0 in 0.299s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:50 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.info is being set with open permissions: ugo+rw Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:50 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.info Nov 04 19:12:50 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:50 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-47b495c9-c72e-4c00-9862-1463b19c6b13" returned: 0 in 0.276s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-47b495c9-c72e-4c00-9862-1463b19c6b13" released by "delete_volume" :: held 0.788s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:50 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.info" returned: 0 in 0.289s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Created reservations ['dfda6c24-1d77-42bb-9ac3-4ee150c0c8c1', '9330f984-ca8c-42aa-8b2a-3b16fe95332e', '8856ae2d-0fcd-4f0d-82e6-6ca2c62d7821', 'f36be007-de2c-4cc5-87e1-cf38c0a28d84'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:50 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-04d4b019-8d52-4267-a06e-b6065fd9e3d4 tempest-ProjectReaderTests-1979060275 None] Create snapshot completed successfully Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:50 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:50 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:50 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:51 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.301s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:51 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Deleted volume successfully. Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-d96c12e2-6e99-4592-b791-db9dfd4f43b7 tempest-ProjectMemberTests-4201210 None] Lock "cinder-47b495c9-c72e-4c00-9862-1463b19c6b13-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (84072e93-b530-4f8e-a3ef-6f3c9209a5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5188763-9781-4003-85f7-414586cef93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5188763-9781-4003-85f7-414586cef93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-689572348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b9d111-342a-4522-82c0-372c69521c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:51Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6262ddca-c044-49cf-b00b-0bc600b6557e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6262ddca-c044-49cf-b00b-0bc600b6557e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc948c1-ef6f-4a62-b220-6697c1da1918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc948c1-ef6f-4a62-b220-6697c1da1918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b9d111-342a-4522-82c0-372c69521c4f', 'volume_name': 'volume-d0b9d111-342a-4522-82c0-372c69521c4f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d20170-84b4-478c-ba19-5390d325357d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d20170-84b4-478c-ba19-5390d325357d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad49b07c-9d14-4962-88cb-6d046e317639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:51 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Volume d0b9d111-342a-4522-82c0-372c69521c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b9d111-342a-4522-82c0-372c69521c4f', 'volume_size': 1} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-689572348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b9d111-342a-4522-82c0-372c69521c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:51Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Creating volume d0b9d111-342a-4522-82c0-372c69521c4f {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:51 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:51 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f 1073741824 Nov 04 19:12:51 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-e2ae62b7-730b-4424-a03c-42b1cdfd87f3-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Lock "cinder-e2ae62b7-730b-4424-a03c-42b1cdfd87f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-6f041181-6acd-4015-aee0-96707dbf922b" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-6f041181-6acd-4015-aee0-96707dbf922b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-e2ae62b7-730b-4424-a03c-42b1cdfd87f3" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-e2ae62b7-730b-4424-a03c-42b1cdfd87f3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Deleting offline snapshot e2ae62b7-730b-4424-a03c-42b1cdfd87f3 of volume 6f041181-6acd-4015-aee0-96707dbf922b {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] snapshot_file for this snap is: volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a8241c-12e3-41d8-8f89-0d8751d5918c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:51 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:52 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 Nov 04 19:12:52 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:52 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f 1073741824" returned: 0 in 0.545s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:52 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f Nov 04 19:12:52 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:52 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3" returned: 0 in 0.435s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f041181-6acd-4015-aee0-96707dbf922b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f693510-2569-4ce7-907d-99994a9076fd]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:52 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b Nov 04 19:12:52 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:52 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f" returned: 0 in 0.327s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad49b07c-9d14-4962-88cb-6d046e317639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b9d111-342a-4522-82c0-372c69521c4f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54fafcf-43a7-420d-80a8-80d07dacfc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:52 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Volume volume-d0b9d111-342a-4522-82c0-372c69521c4f (d0b9d111-342a-4522-82c0-372c69521c4f): created successfully Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54fafcf-43a7-420d-80a8-80d07dacfc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (84072e93-b530-4f8e-a3ef-6f3c9209a5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:52 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-58ed57ff-98b5-4b44-89cf-9d6e60bba209 tempest-ProjectMemberTests-4201210 None] Created volume successfully. Nov 04 19:12:52 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b" returned: 0 in 0.422s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:52 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:52 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 Nov 04 19:12:52 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:53 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3" returned: 0 in 0.337s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:53 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3 Nov 04 19:12:53 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:53 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b.e2ae62b7-730b-4424-a03c-42b1cdfd87f3" returned: 0 in 0.256s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-e2ae62b7-730b-4424-a03c-42b1cdfd87f3" released by "_delete_snapshot" :: held 1.578s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-6f041181-6acd-4015-aee0-96707dbf922b" released by "delete_snapshot" :: held 1.602s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Created reservations ['28e167b8-f57a-4979-a777-bc93227bea7e', 'c2e209e8-1740-4c6c-a6df-1f1ddfe81a4d', '223eea64-5f7e-47c3-806c-1e6f495566d3', 'd80d8723-7ff5-4445-b739-bbac205872c8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:53 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Delete snapshot completed successfully. Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-adafbea6-63f6-4be8-81ae-b59beffa6b4e tempest-ProjectReaderTests-1979060275 None] Lock "cinder-e2ae62b7-730b-4424-a03c-42b1cdfd87f3-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] Creating offline snapshot c062c47e-6e17-417f-a2f8-b28a0c252f80 of volume d0b9d111-342a-4522-82c0-372c69521c4f {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e233d648-baed-4819-a62d-6728ac0d4329]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-6f041181-6acd-4015-aee0-96707dbf922b-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:53 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f Nov 04 19:12:53 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:53 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Lock "cinder-6f041181-6acd-4015-aee0-96707dbf922b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-6f041181-6acd-4015-aee0-96707dbf922b" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-6f041181-6acd-4015-aee0-96707dbf922b" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b117c8-6d46-4548-9ce6-8c49e20af6c6]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:54 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b Nov 04 19:12:54 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:54 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f" returned: 0 in 0.420s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:54 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 1G Nov 04 19:12:54 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:54 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b" returned: 0 in 0.419s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:54 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b Nov 04 19:12:54 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:54 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 1G" returned: 0 in 0.486s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0b9d111-342a-4522-82c0-372c69521c4f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:54 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0b9d111-342a-4522-82c0-372c69521c4f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 Nov 04 19:12:54 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:54 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-6f041181-6acd-4015-aee0-96707dbf922b" returned: 0 in 0.316s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-6f041181-6acd-4015-aee0-96707dbf922b" released by "delete_volume" :: held 0.810s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:54 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Created reservations ['4353de48-9aa4-4c83-8ff9-f05b7d2f88ef', '0583c748-4f35-4879-8b67-ce0d5fb7bc3d', 'dc6e5f97-738f-4e37-b298-40157cc777d9', '278bca23-506d-4a10-984d-46cf3d550252'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:55 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:12:55 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:55 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0b9d111-342a-4522-82c0-372c69521c4f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80" returned: 0 in 0.361s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:55 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 is being set with open permissions: ugo+rw Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:55 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 Nov 04 19:12:55 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:55 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.347s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:12:55 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Deleted volume successfully. Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-59b6d938-6cf7-444e-8d04-fd258e6a332f tempest-ProjectReaderTests-1979060275 None] Lock "cinder-6f041181-6acd-4015-aee0-96707dbf922b-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:55 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80" returned: 0 in 0.344s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:55 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.info Nov 04 19:12:55 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:12:55 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Flow 'volume_create_manager' (77690137-98e1-4ae6-a6ad-e7fe68eaf2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef8fbfb-1e93-4f1d-8487-5f2bc4eb7c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.info" returned: 0 in 0.355s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:55 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.info is being set with open permissions: ugo+rw Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:55 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.info Nov 04 19:12:55 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef8fbfb-1e93-4f1d-8487-5f2bc4eb7c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329372311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32275121-29e3-4294-b6c3-82103c6bc044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a301738da044da8c7d8237afd4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:56Z,use_quota=True,user_id='9d535f9167674e209771286d2fb6c797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1f6bfd-6b07-464a-872d-c33e34eacdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1f6bfd-6b07-464a-872d-c33e34eacdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9da6f1-7186-4fcd-8ce8-10595b325af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9da6f1-7186-4fcd-8ce8-10595b325af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32275121-29e3-4294-b6c3-82103c6bc044', 'volume_name': 'volume-32275121-29e3-4294-b6c3-82103c6bc044', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d90a954-b96b-4021-b2cd-ee05a92468e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d90a954-b96b-4021-b2cd-ee05a92468e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47f7e8b-2a01-41b9-ae69-242552a8a2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:55 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Volume 32275121-29e3-4294-b6c3-82103c6bc044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32275121-29e3-4294-b6c3-82103c6bc044', 'volume_size': 1} Nov 04 19:12:55 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:56 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.info" returned: 0 in 0.253s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1329372311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32275121-29e3-4294-b6c3-82103c6bc044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a301738da044da8c7d8237afd4a085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:12:56Z,use_quota=True,user_id='9d535f9167674e209771286d2fb6c797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Creating volume 32275121-29e3-4294-b6c3-82103c6bc044 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:12:56 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:56 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 1073741824 Nov 04 19:12:56 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:56 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-105a08c8-7e28-4287-8f16-5a09bf095def tempest-ProjectMemberTests-4201210 None] Create snapshot completed successfully Nov 04 19:12:56 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 1073741824" returned: 0 in 0.475s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:56 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 Nov 04 19:12:56 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:56 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044" returned: 0 in 0.262s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47f7e8b-2a01-41b9-ae69-242552a8a2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32275121-29e3-4294-b6c3-82103c6bc044', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095cab83-2016-496f-bbf1-274ebb801433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:12:56 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Volume volume-32275121-29e3-4294-b6c3-82103c6bc044 (32275121-29e3-4294-b6c3-82103c6bc044): created successfully Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095cab83-2016-496f-bbf1-274ebb801433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Flow 'volume_create_manager' (77690137-98e1-4ae6-a6ad-e7fe68eaf2c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:12:56 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-c062c47e-6e17-417f-a2f8-b28a0c252f80-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:57 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-0caa9188-80d7-431a-b2d8-38c2e6b258c1 tempest-ProjectReaderTests-1979060275 None] Created volume successfully. Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Lock "cinder-c062c47e-6e17-417f-a2f8-b28a0c252f80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-d0b9d111-342a-4522-82c0-372c69521c4f" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-d0b9d111-342a-4522-82c0-372c69521c4f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-c062c47e-6e17-417f-a2f8-b28a0c252f80" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-c062c47e-6e17-417f-a2f8-b28a0c252f80" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Deleting offline snapshot c062c47e-6e17-417f-a2f8-b28a0c252f80 of volume d0b9d111-342a-4522-82c0-372c69521c4f {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] snapshot_file for this snap is: volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[04638fb5-4ec6-46b1-bc4b-a6e2005cac06]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:57 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 Nov 04 19:12:57 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:57 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80" returned: 0 in 0.400s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0b9d111-342a-4522-82c0-372c69521c4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[603939ce-f237-4d8a-9c8c-28419ae1ef06]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:57 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f Nov 04 19:12:57 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:57 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f" returned: 0 in 0.407s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:57 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:57 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 Nov 04 19:12:57 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] Creating offline snapshot d28c39a9-88dd-4124-ad19-1ef2a6c71463 of volume 32275121-29e3-4294-b6c3-82103c6bc044 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a075a062-b458-40f1-80d0-dbf4b40b4dba]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:58 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 Nov 04 19:12:58 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:58 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80" returned: 0 in 0.421s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:58 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80 Nov 04 19:12:58 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:58 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044" returned: 0 in 0.401s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:58 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 1G Nov 04 19:12:58 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:58 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f.c062c47e-6e17-417f-a2f8-b28a0c252f80" returned: 0 in 0.282s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-c062c47e-6e17-417f-a2f8-b28a0c252f80" released by "_delete_snapshot" :: held 1.635s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-d0b9d111-342a-4522-82c0-372c69521c4f" released by "delete_snapshot" :: held 1.661s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Created reservations ['d10dd27f-d2c0-48d9-acfb-28e9ee4a023e', 'c152ae19-3fc3-4ac0-8c88-06fc6cc10751', '775acaaf-3e67-4906-a4c0-52163b2984be', '72556449-f464-464e-943a-5b60d9be4f85'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:12:58 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Delete snapshot completed successfully. Nov 04 19:12:58 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-99765a21-4fe9-4cbc-8038-e27623bec942 tempest-ProjectMemberTests-4201210 None] Lock "cinder-c062c47e-6e17-417f-a2f8-b28a0c252f80-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:12:59 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 1G" returned: 0 in 0.518s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32275121-29e3-4294-b6c3-82103c6bc044 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:59 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32275121-29e3-4294-b6c3-82103c6bc044 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 Nov 04 19:12:59 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-d0b9d111-342a-4522-82c0-372c69521c4f-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Lock "cinder-d0b9d111-342a-4522-82c0-372c69521c4f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-d0b9d111-342a-4522-82c0-372c69521c4f" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-d0b9d111-342a-4522-82c0-372c69521c4f" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a39e2fb-0903-4a8c-a559-0020db891668]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:59 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32275121-29e3-4294-b6c3-82103c6bc044 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463" returned: 0 in 0.382s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:59 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 is being set with open permissions: ugo+rw Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:59 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 Nov 04 19:12:59 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:59 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f Nov 04 19:12:59 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:59 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463" returned: 0 in 0.291s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:59 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f" returned: 0 in 0.400s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:12:59 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:12:59 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.info Nov 04 19:12:59 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:12:59 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f Nov 04 19:12:59 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:00 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:00 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-d0b9d111-342a-4522-82c0-372c69521c4f" returned: 0 in 0.280s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.info" returned: 0 in 0.318s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:00 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.info is being set with open permissions: ugo+rw Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-d0b9d111-342a-4522-82c0-372c69521c4f" released by "delete_volume" :: held 0.776s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:00 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.info Nov 04 19:13:00 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Created reservations ['d7637dfa-735a-46f5-943c-301a2e0e01a5', '84db14e5-4436-4642-baad-7d08d4fe0760', 'c4cef756-c10d-46b7-8859-fa6826f1f2c1', '6227e524-3fcc-4976-a458-459d4c45460c'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:00 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:00 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:00 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.info" returned: 0 in 0.282s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:00 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5bdcc367-ebe1-45bd-ab08-a284c67944d9 tempest-ProjectReaderTests-1979060275 None] Create snapshot completed successfully Nov 04 19:13:00 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.310s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:00 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Deleted volume successfully. Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-a197ffb5-04fa-49c6-9862-8ae51712f963 tempest-ProjectMemberTests-4201210 None] Lock "cinder-d0b9d111-342a-4522-82c0-372c69521c4f-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (eb53e7db-b5ee-4e64-b876-19ddccf0a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3218ef-411a-4d40-ad89-3c1ffe331074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3218ef-411a-4d40-ad89-3c1ffe331074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1688663474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ed17d8-679b-47fe-8136-001b5366351f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:01Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb045b70-7822-4ed5-944d-81dabe3a6a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb045b70-7822-4ed5-944d-81dabe3a6a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d013e4e-d82b-4b3a-a09d-b02733c8bb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d013e4e-d82b-4b3a-a09d-b02733c8bb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ed17d8-679b-47fe-8136-001b5366351f', 'volume_name': 'volume-a4ed17d8-679b-47fe-8136-001b5366351f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8903b3e6-ea44-43e5-82e2-f73dd4092f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8903b3e6-ea44-43e5-82e2-f73dd4092f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d870c12-67db-4825-aa0e-6cda21bf2f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:00 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Volume a4ed17d8-679b-47fe-8136-001b5366351f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ed17d8-679b-47fe-8136-001b5366351f', 'volume_size': 1} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1688663474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ed17d8-679b-47fe-8136-001b5366351f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:01Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Creating volume a4ed17d8-679b-47fe-8136-001b5366351f {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:00 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:13:00 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:00 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f 1073741824 Nov 04 19:13:00 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-d28c39a9-88dd-4124-ad19-1ef2a6c71463-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-d28c39a9-88dd-4124-ad19-1ef2a6c71463-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-32275121-29e3-4294-b6c3-82103c6bc044" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-32275121-29e3-4294-b6c3-82103c6bc044" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-d28c39a9-88dd-4124-ad19-1ef2a6c71463" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-d28c39a9-88dd-4124-ad19-1ef2a6c71463" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Deleting offline snapshot d28c39a9-88dd-4124-ad19-1ef2a6c71463 of volume 32275121-29e3-4294-b6c3-82103c6bc044 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] snapshot_file for this snap is: volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5477c6-4ac4-4ef6-a246-7a79f3685659]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:01 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f 1073741824" returned: 0 in 0.556s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:01 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 Nov 04 19:13:01 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:01 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f Nov 04 19:13:01 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:01 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f" returned: 0 in 0.310s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d870c12-67db-4825-aa0e-6cda21bf2f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ed17d8-679b-47fe-8136-001b5366351f', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3b0303-c838-4e10-a382-d1c63e659980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:01 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463" returned: 0 in 0.490s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32275121-29e3-4294-b6c3-82103c6bc044(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:13:01 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Volume volume-a4ed17d8-679b-47fe-8136-001b5366351f (a4ed17d8-679b-47fe-8136-001b5366351f): created successfully Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3b0303-c838-4e10-a382-d1c63e659980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (eb53e7db-b5ee-4e64-b876-19ddccf0a0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf686fc2-8216-412e-a387-c29c1ba0cd75]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:01 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:01 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d0059bd8-7e29-4ab8-8f98-d703be505871 tempest-ProjectMemberTests-4201210 None] Created volume successfully. Nov 04 19:13:02 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 Nov 04 19:13:02 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:02 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044" returned: 0 in 0.403s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:02 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 Nov 04 19:13:02 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:02 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463" returned: 0 in 0.327s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:02 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463 Nov 04 19:13:02 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:02 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:02 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044.d28c39a9-88dd-4124-ad19-1ef2a6c71463" returned: 0 in 0.259s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-d28c39a9-88dd-4124-ad19-1ef2a6c71463" released by "_delete_snapshot" :: held 1.617s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:02 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-32275121-29e3-4294-b6c3-82103c6bc044" released by "delete_snapshot" :: held 1.657s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Created reservations ['96fb319c-94b0-4ea6-bdda-858a5a1a7ef6', '29f27db6-722f-4cfb-933d-dd2f200a8427', 'e91e40b1-9914-44f2-91f5-e05528aadb86', 'b52fafd2-5be2-441f-81e3-c15ced57ec94'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:03 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Delete snapshot completed successfully. Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-11391b4a-afa7-416a-a561-b61d35c28cb0 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-d28c39a9-88dd-4124-ad19-1ef2a6c71463-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] Creating offline snapshot b9ba4a49-ca71-4c20-805e-df6e05937b0a of volume a4ed17d8-679b-47fe-8136-001b5366351f {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ecc3ca-5e17-49bf-b9a0-df8d9e8bc128]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:03 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f Nov 04 19:13:03 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-32275121-29e3-4294-b6c3-82103c6bc044-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-32275121-29e3-4294-b6c3-82103c6bc044-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "cinder-quobyte-32275121-29e3-4294-b6c3-82103c6bc044" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-32275121-29e3-4294-b6c3-82103c6bc044" acquired by "delete_volume" :: waited 0.020s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6431e3-6289-4a37-8ab8-d84ee0354246]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:03 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f" returned: 0 in 0.394s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:03 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a 1G Nov 04 19:13:03 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:03 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 Nov 04 19:13:03 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:03 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044" returned: 0 in 0.374s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:03 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:03 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044 Nov 04 19:13:03 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:04 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a 1G" returned: 0 in 0.442s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ed17d8-679b-47fe-8136-001b5366351f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:04 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ed17d8-679b-47fe-8136-001b5366351f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a Nov 04 19:13:04 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:04 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-32275121-29e3-4294-b6c3-82103c6bc044" returned: 0 in 0.280s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-quobyte-32275121-29e3-4294-b6c3-82103c6bc044" released by "delete_volume" :: held 0.733s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Created reservations ['381802ec-39aa-46e4-8a12-096576d5198b', '8becc557-a120-4d41-a7a3-1eeb3d6f6879', '727813a0-0a8e-4fa2-83ee-5099d10ed997', 'f23b29d7-6857-40ad-a23d-0cbcc6b0abee'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:04 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ed17d8-679b-47fe-8136-001b5366351f -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a" returned: 0 in 0.351s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:04 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a is being set with open permissions: ugo+rw Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:04 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:04 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:04 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a Nov 04 19:13:04 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:04 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:04 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.274s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a" returned: 0 in 0.267s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:04 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Deleted volume successfully. Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-af35ace5-1b02-48c6-ba50-01858b26dfe8 tempest-ProjectReaderTests-1979060275 None] Lock "cinder-32275121-29e3-4294-b6c3-82103c6bc044-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:04 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.info Nov 04 19:13:04 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:04 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.info" returned: 0 in 0.291s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:04 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.info is being set with open permissions: ugo+rw Nov 04 19:13:04 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:04 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.info Nov 04 19:13:04 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:05 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.info" returned: 0 in 0.272s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:05 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:05 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-a57b0d56-23bd-4097-ae1e-47ec90d067e2 tempest-ProjectMemberTests-4201210 None] Create snapshot completed successfully Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-b9ba4a49-ca71-4c20-805e-df6e05937b0a-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Lock "cinder-b9ba4a49-ca71-4c20-805e-df6e05937b0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-a4ed17d8-679b-47fe-8136-001b5366351f" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-a4ed17d8-679b-47fe-8136-001b5366351f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-b9ba4a49-ca71-4c20-805e-df6e05937b0a" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-b9ba4a49-ca71-4c20-805e-df6e05937b0a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Deleting offline snapshot b9ba4a49-ca71-4c20-805e-df6e05937b0a of volume a4ed17d8-679b-47fe-8136-001b5366351f {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] snapshot_file for this snap is: volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55a74b5-42b5-43e8-be97-dd159914d5fd]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:06 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a Nov 04 19:13:06 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:06 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a" returned: 0 in 0.390s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4ed17d8-679b-47fe-8136-001b5366351f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[32817a15-64ac-410b-a22c-198a1dac5c9e]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:06 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:06 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f Nov 04 19:13:06 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:07 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f" returned: 0 in 0.372s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:07 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a Nov 04 19:13:07 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:07 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a" returned: 0 in 0.372s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:07 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a Nov 04 19:13:07 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:07 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:07 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f.b9ba4a49-ca71-4c20-805e-df6e05937b0a" returned: 0 in 0.256s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-b9ba4a49-ca71-4c20-805e-df6e05937b0a" released by "_delete_snapshot" :: held 1.498s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:07 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-a4ed17d8-679b-47fe-8136-001b5366351f" released by "delete_snapshot" :: held 1.520s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:07 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Created reservations ['3bf1a455-8354-4cdd-b408-83c35188c046', '56233b89-fe84-4980-8e6a-a800cdd02fed', '65180479-3a67-4855-be3d-95f9f4f3c17a', 'ab61eb0f-5815-43cc-b59d-4a2b9d2aa439'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:08 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Delete snapshot completed successfully. Nov 04 19:13:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-113b679c-115a-439f-9266-2e23f78a35cb tempest-ProjectMemberTests-4201210 None] Lock "cinder-b9ba4a49-ca71-4c20-805e-df6e05937b0a-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-a4ed17d8-679b-47fe-8136-001b5366351f-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Lock "cinder-a4ed17d8-679b-47fe-8136-001b5366351f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-a4ed17d8-679b-47fe-8136-001b5366351f" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:08 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-a4ed17d8-679b-47fe-8136-001b5366351f" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:08 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[054a5652-7b3a-43e9-8149-8ea634ddcde3]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:08 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:08 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f Nov 04 19:13:08 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:09 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f" returned: 0 in 0.404s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:09 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f Nov 04 19:13:09 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:09 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-a4ed17d8-679b-47fe-8136-001b5366351f" returned: 0 in 0.293s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-a4ed17d8-679b-47fe-8136-001b5366351f" released by "delete_volume" :: held 0.784s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Created reservations ['c33c95bd-991c-44d2-a1d8-18407c38ab74', '9569bccb-1d77-4bc5-bff0-926abc37bb91', '6731b562-9b27-4c85-9dd0-b2d3ae3a23e4', '5964bb7e-e52b-4c33-a93b-56a289ae2ad8'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:09 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:09 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:09 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.269s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:09 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Deleted volume successfully. Nov 04 19:13:09 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-8161f39a-ba5c-4838-b1a0-4d5d231d6912 tempest-ProjectMemberTests-4201210 None] Lock "cinder-a4ed17d8-679b-47fe-8136-001b5366351f-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (507d5ce5-abc4-4c87-8e72-64a822eddcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd84ad1-cdcb-479c-86ca-8eaf98eec831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd84ad1-cdcb-479c-86ca-8eaf98eec831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1254057198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3ceb89-5f43-4b50-92e3-87c491db78ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:10Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5697ef-7114-4beb-b45b-eea14871af67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5697ef-7114-4beb-b45b-eea14871af67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bb983d-0b8f-4fb6-a559-c306ad988e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bb983d-0b8f-4fb6-a559-c306ad988e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3ceb89-5f43-4b50-92e3-87c491db78ba', 'volume_name': 'volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d20dec-e9a3-4a99-ac49-a641f0d4a2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d20dec-e9a3-4a99-ac49-a641f0d4a2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb0dacc-d187-4dba-8150-715c05a08eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:10 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Volume 8e3ceb89-5f43-4b50-92e3-87c491db78ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba', 'volume_size': 1} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1254057198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3ceb89-5f43-4b50-92e3-87c491db78ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:10Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Creating volume 8e3ceb89-5f43-4b50-92e3-87c491db78ba {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:10 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:10 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba 1073741824 Nov 04 19:13:10 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:10 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba 1073741824" returned: 0 in 0.483s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:10 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:10 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba Nov 04 19:13:10 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:11 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba" returned: 0 in 0.298s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:11 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:11 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb0dacc-d187-4dba-8150-715c05a08eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def84e41-0cdd-477f-9baf-f1d29ec4d6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:11 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Volume volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba (8e3ceb89-5f43-4b50-92e3-87c491db78ba): created successfully Nov 04 19:13:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def84e41-0cdd-477f-9baf-f1d29ec4d6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:11 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (507d5ce5-abc4-4c87-8e72-64a822eddcb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:11 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3d2704bd-1b8c-4a9f-94fe-cf3c8b102ab1 tempest-ProjectMemberTests-4201210 None] Created volume successfully. Nov 04 19:13:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:12 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] Creating offline snapshot c464ace8-2194-422f-89e3-da3bb52bcba0 of volume 8e3ceb89-5f43-4b50-92e3-87c491db78ba {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:13:12 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece68ee0-08e9-4659-a2c7-2086a11d8317]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:12 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba Nov 04 19:13:12 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:12 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba" returned: 0 in 0.387s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:12 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:12 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 1G Nov 04 19:13:12 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:13 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 1G" returned: 0 in 0.445s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:13 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 Nov 04 19:13:13 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Flow 'volume_create_manager' (0d5f184c-709a-497b-9ecb-db7315784284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68180d5-3f24-414c-b707-8631eb93d7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68180d5-3f24-414c-b707-8631eb93d7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039706021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e152dd9-e94c-4557-804f-1941cc50311c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a6a6f16ccc471d91a6b26dea54f073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:13Z,use_quota=True,user_id='b79a102496394790b2642f9945df8ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3134066-08f0-428d-b521-e6f90adc2b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3134066-08f0-428d-b521-e6f90adc2b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b08dcb-68d8-4c73-8b3c-ef93eb3b8926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b08dcb-68d8-4c73-8b3c-ef93eb3b8926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e152dd9-e94c-4557-804f-1941cc50311c', 'volume_name': 'volume-2e152dd9-e94c-4557-804f-1941cc50311c', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1251b192-f210-45af-8abf-edc93753153d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1251b192-f210-45af-8abf-edc93753153d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea7bbee-eae4-42e0-bfcc-d62bee6a87d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:13 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Volume 2e152dd9-e94c-4557-804f-1941cc50311c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e152dd9-e94c-4557-804f-1941cc50311c', 'volume_size': 1} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:13 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0" returned: 0 in 0.329s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:13 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 is being set with open permissions: ugo+rw Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:13 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 Nov 04 19:13:13 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:13 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0" returned: 0 in 0.242s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:13 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:13 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.info Nov 04 19:13:13 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:14 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.info" returned: 0 in 0.254s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:14 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.info is being set with open permissions: ugo+rw Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:14 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.info Nov 04 19:13:14 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:14 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.info" returned: 0 in 0.247s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039706021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e152dd9-e94c-4557-804f-1941cc50311c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a6a6f16ccc471d91a6b26dea54f073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:13Z,use_quota=True,user_id='b79a102496394790b2642f9945df8ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Creating volume 2e152dd9-e94c-4557-804f-1941cc50311c {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:14 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:14 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c 1073741824 Nov 04 19:13:14 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:14 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ffd8d240-4517-43b7-893f-e9a5eacb2469 tempest-ProjectMemberTests-4201210 None] Create snapshot completed successfully Nov 04 19:13:14 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c 1073741824" returned: 0 in 0.411s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:14 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:14 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c Nov 04 19:13:14 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:15 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c" returned: 0 in 0.246s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea7bbee-eae4-42e0-bfcc-d62bee6a87d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e152dd9-e94c-4557-804f-1941cc50311c', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128b6225-9010-4511-b141-974b8440193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:15 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Volume volume-2e152dd9-e94c-4557-804f-1941cc50311c (2e152dd9-e94c-4557-804f-1941cc50311c): created successfully Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128b6225-9010-4511-b141-974b8440193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Flow 'volume_create_manager' (0d5f184c-709a-497b-9ecb-db7315784284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:15 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-773b2127-e116-46c9-8df4-2c4fe0a22009 tempest-ProjectReaderTests-1658368968 None] Created volume successfully. Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-c464ace8-2194-422f-89e3-da3bb52bcba0-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Lock "cinder-c464ace8-2194-422f-89e3-da3bb52bcba0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-8e3ceb89-5f43-4b50-92e3-87c491db78ba" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-8e3ceb89-5f43-4b50-92e3-87c491db78ba" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-c464ace8-2194-422f-89e3-da3bb52bcba0" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-c464ace8-2194-422f-89e3-da3bb52bcba0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Deleting offline snapshot c464ace8-2194-422f-89e3-da3bb52bcba0 of volume 8e3ceb89-5f43-4b50-92e3-87c491db78ba {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] snapshot_file for this snap is: volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1889b625-38d7-4568-adb7-f15dc16403df]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "cinder-2e152dd9-e94c-4557-804f-1941cc50311c-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-2e152dd9-e94c-4557-804f-1941cc50311c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "cinder-quobyte-2e152dd9-e94c-4557-804f-1941cc50311c" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-quobyte-2e152dd9-e94c-4557-804f-1941cc50311c" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:15 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 Nov 04 19:13:15 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb059cd2-99e2-46ee-b080-df2f519ffae8]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:15 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:15 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c Nov 04 19:13:15 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:16 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0" returned: 0 in 0.408s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dd2bfa-1c4f-4f9c-bbff-1784ade3732a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:16 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c" returned: 0 in 0.375s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:16 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:16 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:16 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba Nov 04 19:13:16 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:16 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:16 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:16 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-2e152dd9-e94c-4557-804f-1941cc50311c" returned: 0 in 0.284s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:16 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.269s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-quobyte-2e152dd9-e94c-4557-804f-1941cc50311c" released by "delete_volume" :: held 0.726s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:13:16 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba" returned: 0 in 0.407s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:16 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 Nov 04 19:13:16 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Created reservations ['bf6eb49e-6271-4248-a1f5-d0eba8469e4e', '020e8d9c-788a-40ef-97ff-2d477e2a2434', '7d697db3-6572-47e3-bd7a-ee61d45941da', 'ba4833a0-d0ce-4325-9fd1-c1fb535636c5'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:16 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:16 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:16 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0" returned: 0 in 0.375s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:16 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0 Nov 04 19:13:16 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:16 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.277s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:16 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Deleted volume successfully. Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-7666cda1-969e-4312-ab88-b47ca58f0780 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-2e152dd9-e94c-4557-804f-1941cc50311c-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:17 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba.c464ace8-2194-422f-89e3-da3bb52bcba0" returned: 0 in 0.263s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-c464ace8-2194-422f-89e3-da3bb52bcba0" released by "_delete_snapshot" :: held 1.571s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-8e3ceb89-5f43-4b50-92e3-87c491db78ba" released by "delete_snapshot" :: held 1.597s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Created reservations ['befbcd99-daba-4b4b-aa4a-96323b921c17', 'e033d658-6a7a-4095-94ff-0a0234a63a2c', '38cd6711-e2d0-4c2f-9816-e0f11c00fcf2', 'c7e1259b-c7ec-4ea6-a545-5c7ce278dbf2'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Flow 'volume_create_manager' (2ac9814a-c114-4e75-adb8-966425998824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d6c128-1b95-4bc7-b6ba-d0833dd6b2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d6c128-1b95-4bc7-b6ba-d0833dd6b2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235970353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf49f7df-3912-4c02-b073-d397d1039675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a6a6f16ccc471d91a6b26dea54f073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:17Z,use_quota=True,user_id='b79a102496394790b2642f9945df8ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a09977-5c61-4c51-ba95-b2a03385f609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a09977-5c61-4c51-ba95-b2a03385f609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d1bb87-e3a7-4870-a6f6-e90d7c1106b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d1bb87-e3a7-4870-a6f6-e90d7c1106b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf49f7df-3912-4c02-b073-d397d1039675', 'volume_name': 'volume-bf49f7df-3912-4c02-b073-d397d1039675', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a9d02d-142c-42ff-b6ac-b3d3fdde15b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a9d02d-142c-42ff-b6ac-b3d3fdde15b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7641aeb-fc11-4b5d-be0c-618eb4e9bddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:17 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Volume bf49f7df-3912-4c02-b073-d397d1039675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf49f7df-3912-4c02-b073-d397d1039675', 'volume_size': 1} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1235970353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf49f7df-3912-4c02-b073-d397d1039675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a6a6f16ccc471d91a6b26dea54f073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:17Z,use_quota=True,user_id='b79a102496394790b2642f9945df8ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Creating volume bf49f7df-3912-4c02-b073-d397d1039675 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:17 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:17 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Delete snapshot completed successfully. Nov 04 19:13:17 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675 1073741824 Nov 04 19:13:17 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-5ce382d2-d940-48e1-9429-e79c87e19834 tempest-ProjectMemberTests-4201210 None] Lock "cinder-c464ace8-2194-422f-89e3-da3bb52bcba0-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-8e3ceb89-5f43-4b50-92e3-87c491db78ba-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Lock "cinder-8e3ceb89-5f43-4b50-92e3-87c491db78ba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-8e3ceb89-5f43-4b50-92e3-87c491db78ba" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-8e3ceb89-5f43-4b50-92e3-87c491db78ba" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dafb05a-b964-4fff-9e67-8eeefc17a277]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:17 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675 1073741824" returned: 0 in 0.503s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:17 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:18 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675 Nov 04 19:13:18 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:18 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba Nov 04 19:13:18 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:18 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675" returned: 0 in 0.259s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7641aeb-fc11-4b5d-be0c-618eb4e9bddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf49f7df-3912-4c02-b073-d397d1039675', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db131196-4e91-4b99-b732-8bc6197b6019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:18 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Volume volume-bf49f7df-3912-4c02-b073-d397d1039675 (bf49f7df-3912-4c02-b073-d397d1039675): created successfully Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db131196-4e91-4b99-b732-8bc6197b6019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Flow 'volume_create_manager' (2ac9814a-c114-4e75-adb8-966425998824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:18 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f5699144-36a2-4091-b656-7a1e156c2645 tempest-ProjectReaderTests-1658368968 None] Created volume successfully. Nov 04 19:13:18 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba" returned: 0 in 0.409s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:18 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba Nov 04 19:13:18 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:18 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-8e3ceb89-5f43-4b50-92e3-87c491db78ba" returned: 0 in 0.247s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-8e3ceb89-5f43-4b50-92e3-87c491db78ba" released by "delete_volume" :: held 0.719s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Created reservations ['1fb9bc19-473c-4503-98d8-606692110bd1', '1c1b9e21-5bc3-4362-bbcd-7038f69675a4', '7cb26f58-e75c-46e9-8d5f-2ac48463dba3', 'f93abb98-91a0-4624-938f-ed304bd57f4f'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:18 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:18 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:18 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.259s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:18 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:19 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Deleted volume successfully. Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-510a169c-5212-46b5-ae5d-1f5ee0cdae33 tempest-ProjectMemberTests-4201210 None] Lock "cinder-8e3ceb89-5f43-4b50-92e3-87c491db78ba-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (64328a92-299a-4dfd-91cc-bd42572e1c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9707a94-aed4-40ec-a3fe-dd6d48a00ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "cinder-bf49f7df-3912-4c02-b073-d397d1039675-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9707a94-aed4-40ec-a3fe-dd6d48a00ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667541107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb7f243-9579-4c8e-89dd-b22292f8d8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:19Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e30c14-f6aa-49de-96d1-7906255535cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e30c14-f6aa-49de-96d1-7906255535cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38128e30-8076-4f5b-a1d8-19f131273b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38128e30-8076-4f5b-a1d8-19f131273b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb7f243-9579-4c8e-89dd-b22292f8d8a6', 'volume_name': 'volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcff812-9639-4c6b-9a57-7d93c0f8643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcff812-9639-4c6b-9a57-7d93c0f8643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd8a21b-3ad5-423f-b85e-13205ec7eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:19 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Volume 7eb7f243-9579-4c8e-89dd-b22292f8d8a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6', 'volume_size': 1} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667541107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb7f243-9579-4c8e-89dd-b22292f8d8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:19Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Creating volume 7eb7f243-9579-4c8e-89dd-b22292f8d8a6 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:19 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-bf49f7df-3912-4c02-b073-d397d1039675-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:19 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 1073741824 Nov 04 19:13:19 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "cinder-quobyte-bf49f7df-3912-4c02-b073-d397d1039675" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-quobyte-bf49f7df-3912-4c02-b073-d397d1039675" acquired by "delete_volume" :: waited 0.013s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ec7534-76ac-4e16-a37a-d9f116509f86]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:19 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:19 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675 Nov 04 19:13:19 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:20 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 1073741824" returned: 0 in 0.460s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:20 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675" returned: 0 in 0.393s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:20 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 Nov 04 19:13:20 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:20 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675 Nov 04 19:13:20 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:20 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6" returned: 0 in 0.256s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:20 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bf49f7df-3912-4c02-b073-d397d1039675" returned: 0 in 0.251s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd8a21b-3ad5-423f-b85e-13205ec7eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a813602-568b-4432-ab8d-04d9bce72406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-quobyte-bf49f7df-3912-4c02-b073-d397d1039675" released by "delete_volume" :: held 0.705s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:20 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Volume volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 (7eb7f243-9579-4c8e-89dd-b22292f8d8a6): created successfully Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a813602-568b-4432-ab8d-04d9bce72406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (64328a92-299a-4dfd-91cc-bd42572e1c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:20 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d7f00610-d5d6-40d7-91b7-512df528b313 tempest-ProjectMemberTests-4201210 None] Created volume successfully. Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Created reservations ['4b778b1e-9367-4af0-9a7a-5d9d9953955b', '4f6db073-4728-41f4-bfca-cb0256d9e4b6', 'b890a63d-cad2-42d7-b815-ad93b1df7695', '11220e19-6206-4428-bbd8-b8f9f6aef81e'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:20 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:20 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:20 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.269s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:20 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Deleted volume successfully. Nov 04 19:13:20 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-f49f97b9-07d6-4a84-bc92-6d59c0409c33 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-bf49f7df-3912-4c02-b073-d397d1039675-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Flow 'volume_create_manager' (dd967781-3096-492d-9a34-1871a8787f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81865106-9f92-4464-b758-f134d2d92d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81865106-9f92-4464-b758-f134d2d92d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-801275892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094be45f-83df-4ab8-b9d9-d831cdbd563c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a6a6f16ccc471d91a6b26dea54f073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:21Z,use_quota=True,user_id='b79a102496394790b2642f9945df8ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b6a0d8-4ae2-457b-81c1-154686ca56b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b6a0d8-4ae2-457b-81c1-154686ca56b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4388b77-a72d-4f6f-9d1d-a83f1dda4411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4388b77-a72d-4f6f-9d1d-a83f1dda4411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094be45f-83df-4ab8-b9d9-d831cdbd563c', 'volume_name': 'volume-094be45f-83df-4ab8-b9d9-d831cdbd563c', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82de2529-6ec4-474d-992b-a2a68c672a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82de2529-6ec4-474d-992b-a2a68c672a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf8406b-e093-4561-b1c3-2be6ab848e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:21 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Volume 094be45f-83df-4ab8-b9d9-d831cdbd563c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094be45f-83df-4ab8-b9d9-d831cdbd563c', 'volume_size': 1} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-801275892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094be45f-83df-4ab8-b9d9-d831cdbd563c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a6a6f16ccc471d91a6b26dea54f073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:21Z,use_quota=True,user_id='b79a102496394790b2642f9945df8ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Creating volume 094be45f-83df-4ab8-b9d9-d831cdbd563c {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:21 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:21 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c 1073741824 Nov 04 19:13:21 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:21 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c 1073741824" returned: 0 in 0.458s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:21 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c Nov 04 19:13:21 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:21 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c" returned: 0 in 0.236s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.294s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf8406b-e093-4561-b1c3-2be6ab848e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094be45f-83df-4ab8-b9d9-d831cdbd563c', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9bae4b-ae21-44a3-9e2c-b605bb8605cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] Creating offline snapshot f45b918e-a257-456e-b2bc-6f68b7b310c0 of volume 7eb7f243-9579-4c8e-89dd-b22292f8d8a6 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:13:22 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Volume volume-094be45f-83df-4ab8-b9d9-d831cdbd563c (094be45f-83df-4ab8-b9d9-d831cdbd563c): created successfully Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9bae4b-ae21-44a3-9e2c-b605bb8605cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Flow 'volume_create_manager' (dd967781-3096-492d-9a34-1871a8787f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cb1baa-6a34-4518-892d-891d96e10e37]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:22 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-2f0f5f4f-ae3b-4c5a-9cd2-f54e756cec7f tempest-ProjectReaderTests-1658368968 None] Created volume successfully. Nov 04 19:13:22 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 Nov 04 19:13:22 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "cinder-094be45f-83df-4ab8-b9d9-d831cdbd563c-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-094be45f-83df-4ab8-b9d9-d831cdbd563c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "cinder-quobyte-094be45f-83df-4ab8-b9d9-d831cdbd563c" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-quobyte-094be45f-83df-4ab8-b9d9-d831cdbd563c" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65f1d92-49cd-4750-a045-34d2b8f5822a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:22 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6" returned: 0 in 0.374s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:22 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 1G Nov 04 19:13:22 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:22 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c Nov 04 19:13:22 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:22 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c" returned: 0 in 0.370s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:22 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c Nov 04 19:13:22 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:22 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 1G" returned: 0 in 0.405s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:22 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 Nov 04 19:13:22 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:22 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-094be45f-83df-4ab8-b9d9-d831cdbd563c" returned: 0 in 0.252s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-quobyte-094be45f-83df-4ab8-b9d9-d831cdbd563c" released by "delete_volume" :: held 0.670s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Created reservations ['66d50d9d-4e8c-4472-b4c4-e922836e0318', '6ff62f92-0803-4303-bb7a-b2b5cf3af46e', '3d577dd5-a235-4d34-a282-8ede14782a6d', 'ee004d08-f5c1-4455-bf12-9bb67fce740f'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:23 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0" returned: 0 in 0.334s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:23 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 is being set with open permissions: ugo+rw Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:23 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:23 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:23 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 Nov 04 19:13:23 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:23 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:23 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0" returned: 0 in 0.249s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.268s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:23 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Deleted volume successfully. Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:23 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.info Nov 04 19:13:23 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-10c5a2d5-b364-42b8-bede-0796a88592b6 tempest-ProjectReaderTests-1658368968 None] Lock "cinder-094be45f-83df-4ab8-b9d9-d831cdbd563c-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:23 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.info" returned: 0 in 0.297s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:23 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.info is being set with open permissions: ugo+rw Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:23 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.info Nov 04 19:13:23 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Flow 'volume_create_manager' (669a47d2-ed5a-42a0-9c15-1a5e71cbce66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff1eafa-6b60-402d-a609-574f44058f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff1eafa-6b60-402d-a609-574f44058f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153352033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5442c89-9c7e-48ee-944f-cb74c69d7b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a6a6f16ccc471d91a6b26dea54f073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:24Z,use_quota=True,user_id='b79a102496394790b2642f9945df8ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689fa081-3d8e-494b-b88f-24006df95873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689fa081-3d8e-494b-b88f-24006df95873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7618916-b402-4ab2-b634-3ab82b5ae190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7618916-b402-4ab2-b634-3ab82b5ae190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5442c89-9c7e-48ee-944f-cb74c69d7b95', 'volume_name': 'volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cd5bfe-b920-420d-88e3-feb410644210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cd5bfe-b920-420d-88e3-feb410644210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f33e27-040c-4470-99f8-49cba8aa6891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:23 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Volume c5442c89-9c7e-48ee-944f-cb74c69d7b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95', 'volume_size': 1} Nov 04 19:13:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:24 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.info" returned: 0 in 0.244s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.084s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153352033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5442c89-9c7e-48ee-944f-cb74c69d7b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a6a6f16ccc471d91a6b26dea54f073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:24Z,use_quota=True,user_id='b79a102496394790b2642f9945df8ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Creating volume c5442c89-9c7e-48ee-944f-cb74c69d7b95 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:24 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:24 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95 1073741824 Nov 04 19:13:24 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3d382d23-1c11-4292-a24a-a0de896df716 tempest-ProjectMemberTests-4201210 None] Create snapshot completed successfully Nov 04 19:13:24 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95 1073741824" returned: 0 in 0.406s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:24 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95 Nov 04 19:13:24 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:24 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95" returned: 0 in 0.259s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f33e27-040c-4470-99f8-49cba8aa6891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7940cb3e-a46a-46e5-805a-f4169fd01d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:24 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Volume volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95 (c5442c89-9c7e-48ee-944f-cb74c69d7b95): created successfully Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7940cb3e-a46a-46e5-805a-f4169fd01d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Flow 'volume_create_manager' (669a47d2-ed5a-42a0-9c15-1a5e71cbce66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:24 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b85383f5-9b18-4dbe-9729-b05e582da3b8 tempest-ProjectReaderTests-1658368968 None] Created volume successfully. Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-f45b918e-a257-456e-b2bc-6f68b7b310c0-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Lock "cinder-f45b918e-a257-456e-b2bc-6f68b7b310c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-7eb7f243-9579-4c8e-89dd-b22292f8d8a6" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-7eb7f243-9579-4c8e-89dd-b22292f8d8a6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-f45b918e-a257-456e-b2bc-6f68b7b310c0" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-f45b918e-a257-456e-b2bc-6f68b7b310c0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Deleting offline snapshot f45b918e-a257-456e-b2bc-6f68b7b310c0 of volume 7eb7f243-9579-4c8e-89dd-b22292f8d8a6 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] snapshot_file for this snap is: volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e3c213-81ec-4ea8-9d98-c9c1e04319ed]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:24 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:25 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 Nov 04 19:13:25 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:25 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0" returned: 0 in 0.344s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:13:25 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b5d03e-3366-43e5-93a0-ac4158a9eb70]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:25 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 Nov 04 19:13:25 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:25 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6" returned: 0 in 0.346s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:25 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 Nov 04 19:13:25 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:25 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Acquiring lock "cinder-c5442c89-9c7e-48ee-944f-cb74c69d7b95-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0" returned: 0 in 0.359s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Lock "cinder-c5442c89-9c7e-48ee-944f-cb74c69d7b95-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:26 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0 Nov 04 19:13:26 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Acquiring lock "cinder-quobyte-c5442c89-9c7e-48ee-944f-cb74c69d7b95" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Lock "cinder-quobyte-c5442c89-9c7e-48ee-944f-cb74c69d7b95" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c180c4b-190d-40b2-a644-0c33c750bc3c]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:26 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95 Nov 04 19:13:26 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:26 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6.f45b918e-a257-456e-b2bc-6f68b7b310c0" returned: 0 in 0.281s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-f45b918e-a257-456e-b2bc-6f68b7b310c0" released by "_delete_snapshot" :: held 1.416s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-7eb7f243-9579-4c8e-89dd-b22292f8d8a6" released by "delete_snapshot" :: held 1.438s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Created reservations ['54fcea66-699b-4616-b6b8-cda572f175ad', '71ee3d53-285e-402c-9bc2-87cf6e14075a', '36e110fe-ff4a-470e-81f1-ae65d0090dac', '9837718f-d0e1-4517-9d5c-8118f04f7688'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:26 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Delete snapshot completed successfully. Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-64abc5d4-2f50-4cbc-ac10-85761923e0b9 tempest-ProjectMemberTests-4201210 None] Lock "cinder-f45b918e-a257-456e-b2bc-6f68b7b310c0-delete_snapshot" released by "delete_snapshot" :: held 1.570s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:26 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95" returned: 0 in 0.371s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:26 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95 Nov 04 19:13:26 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:26 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-c5442c89-9c7e-48ee-944f-cb74c69d7b95" returned: 0 in 0.233s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Lock "cinder-quobyte-c5442c89-9c7e-48ee-944f-cb74c69d7b95" released by "delete_volume" :: held 0.650s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Created reservations ['1431546f-ba9c-4d6a-b199-ccb026164315', '8cf55ebb-e743-4c91-a2ba-a2ba6b24fec8', 'd1086f8d-5ec2-488a-a811-5fddddb33afc', '3781e198-6b37-4170-b373-fb180ccd249b'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:26 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:26 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-7eb7f243-9579-4c8e-89dd-b22292f8d8a6-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Lock "cinder-7eb7f243-9579-4c8e-89dd-b22292f8d8a6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:27 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-7eb7f243-9579-4c8e-89dd-b22292f8d8a6" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.259s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:27 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Deleted volume successfully. Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-7eb7f243-9579-4c8e-89dd-b22292f8d8a6" acquired by "delete_volume" :: waited 0.025s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-3f1c38e0-6f81-4704-8fc2-6acd6b2b61fb tempest-ProjectReaderTests-1658368968 None] Lock "cinder-c5442c89-9c7e-48ee-944f-cb74c69d7b95-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3d2284-b897-4479-a9e5-06d1df82e154]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:27 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 Nov 04 19:13:27 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:27 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6" returned: 0 in 0.366s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:27 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6 Nov 04 19:13:27 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:27 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-7eb7f243-9579-4c8e-89dd-b22292f8d8a6" returned: 0 in 0.245s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-7eb7f243-9579-4c8e-89dd-b22292f8d8a6" released by "delete_volume" :: held 0.692s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Created reservations ['93ebd93a-f11f-46d5-aaea-f74470cda4c7', '4aa1eeac-d979-479c-9938-2c1888b926a9', '1aaf0b48-5a7a-4f28-859b-c2a3ae00b250', 'c2b77f81-1e70-4ebe-b5f7-c2937e13cc34'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:27 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:27 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:27 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:28 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.264s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:28 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Deleted volume successfully. Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ac27911a-03a1-485b-b1ff-585c0c059ced tempest-ProjectMemberTests-4201210 None] Lock "cinder-7eb7f243-9579-4c8e-89dd-b22292f8d8a6-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (69913a9d-738f-462d-af0f-f2859367b9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8167eda8-f14f-4c3b-b1e7-6e936dbffe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8167eda8-f14f-4c3b-b1e7-6e936dbffe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-358741017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2fa8c6-ad57-4652-b6c5-c88bb11d9610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:29Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e370da-9a87-4f23-85f1-092b467195bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e370da-9a87-4f23-85f1-092b467195bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3107a26-bcd5-481d-980e-7d641ca5a862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3107a26-bcd5-481d-980e-7d641ca5a862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2fa8c6-ad57-4652-b6c5-c88bb11d9610', 'volume_name': 'volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77006dd9-aa40-466e-ae7f-b053100ad54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77006dd9-aa40-466e-ae7f-b053100ad54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950f54e2-1adb-41d4-ad8e-5516877f7e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:28 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Volume bb2fa8c6-ad57-4652-b6c5-c88bb11d9610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610', 'volume_size': 1} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-358741017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2fa8c6-ad57-4652-b6c5-c88bb11d9610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:29Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Creating volume bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:28 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:13:28 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:28 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 1073741824 Nov 04 19:13:28 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:29 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 1073741824" returned: 0 in 0.434s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:29 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 Nov 04 19:13:29 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:29 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610" returned: 0 in 0.244s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950f54e2-1adb-41d4-ad8e-5516877f7e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8f3f31-67c5-4033-b5f0-22b855120d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:29 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Volume volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 (bb2fa8c6-ad57-4652-b6c5-c88bb11d9610): created successfully Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8f3f31-67c5-4033-b5f0-22b855120d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (69913a9d-738f-462d-af0f-f2859367b9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:29 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9b78366f-71a0-4b4d-86f8-3fc017b0c299 tempest-ProjectMemberTests-4201210 None] Created volume successfully. Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] Creating offline snapshot 115e1c7c-ae99-4507-a706-a4d632c5ae59 of volume bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[899d0402-2e90-4c8a-8322-f9ec9bc9c35f]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:29 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:29 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 Nov 04 19:13:29 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:30 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610" returned: 0 in 0.345s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:30 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 1G Nov 04 19:13:30 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:30 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 1G" returned: 0 in 0.382s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:30 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 Nov 04 19:13:30 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:30 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59" returned: 0 in 0.302s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:30 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 is being set with open permissions: ugo+rw Nov 04 19:13:30 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:30 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 Nov 04 19:13:30 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:31 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59" returned: 0 in 0.236s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:31 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.info Nov 04 19:13:31 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:31 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.info" returned: 0 in 0.255s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:31 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.info is being set with open permissions: ugo+rw Nov 04 19:13:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:31 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.info Nov 04 19:13:31 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:31 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.info" returned: 0 in 0.236s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:31 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:31 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b4656d79-4bfe-4c08-9186-0ad8da8c66ca tempest-ProjectMemberTests-4201210 None] Create snapshot completed successfully Nov 04 19:13:31 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-115e1c7c-ae99-4507-a706-a4d632c5ae59-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Lock "cinder-115e1c7c-ae99-4507-a706-a4d632c5ae59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-115e1c7c-ae99-4507-a706-a4d632c5ae59" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-115e1c7c-ae99-4507-a706-a4d632c5ae59" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Deleting offline snapshot 115e1c7c-ae99-4507-a706-a4d632c5ae59 of volume bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] snapshot_file for this snap is: volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8584b557-aba8-4ad3-bf1c-43a12deef29a]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:32 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 Nov 04 19:13:32 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:32 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59" returned: 0 in 0.359s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95a3f80-3b59-41e7-89f0-204b1548efdd]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:32 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 Nov 04 19:13:32 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:32 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610" returned: 0 in 0.384s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:32 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 Nov 04 19:13:32 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:33 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59" returned: 0 in 0.347s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:33 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59 Nov 04 19:13:33 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:33 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610.115e1c7c-ae99-4507-a706-a4d632c5ae59" returned: 0 in 0.249s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-115e1c7c-ae99-4507-a706-a4d632c5ae59" released by "_delete_snapshot" :: held 1.437s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610" released by "delete_snapshot" :: held 1.457s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:33 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=172,cinder:UPDATE=246,cinder:INSERT=62,cinder:DELETE=22 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:13:33 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=187,cinder:INSERT=67,cinder:UPDATE=237,cinder:DELETE=19 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:13:33 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Created reservations ['d3d07451-417f-4c1c-a733-c23e2528ff77', 'f3249838-1d54-496e-8fe5-2f7afddab031', '2152714f-3b1d-43d3-918b-28ab34184895', '7ffe9cbc-1ccc-422c-aa4c-23e4707fd68d'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:33 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Delete snapshot completed successfully. Nov 04 19:13:33 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-fe5ac998-bba3-4861-8391-dbe2c14f7709 tempest-ProjectMemberTests-4201210 None] Lock "cinder-115e1c7c-ae99-4507-a706-a4d632c5ae59-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Lock "cinder-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[792cad54-bd14-43fa-a522-5cff3a24d32d]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:34 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 Nov 04 19:13:34 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:34 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610" returned: 0 in 0.347s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:34 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610 Nov 04 19:13:34 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:34 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610" returned: 0 in 0.236s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610" released by "delete_volume" :: held 0.647s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Created reservations ['5aa93d41-19e9-4211-855d-73ef6b78e0d8', '89685b48-a1f4-48e3-9003-1c4087a2bcb2', 'c70577b0-b4c8-4fad-af2c-b52f2b5f303a', '6b9a0041-52fd-4808-8b95-eec84ed42dc2'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:35 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:35 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:35 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.234s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:35 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Deleted volume successfully. Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b400ae3f-4f61-41df-beb6-0fc33f58e576 tempest-ProjectMemberTests-4201210 None] Lock "cinder-bb2fa8c6-ad57-4652-b6c5-c88bb11d9610-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (34c430de-cfcf-4db2-990d-41086aaff85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525ae798-7f33-4534-ae1b-332c2ab1046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525ae798-7f33-4534-ae1b-332c2ab1046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415617356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba877640-4f0c-4b6d-838d-5282249e91ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:36Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9995c4-3a54-48ff-91e1-4fd4543d85d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9995c4-3a54-48ff-91e1-4fd4543d85d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabc07a1-4264-4772-b454-545f76f3634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabc07a1-4264-4772-b454-545f76f3634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba877640-4f0c-4b6d-838d-5282249e91ed', 'volume_name': 'volume-ba877640-4f0c-4b6d-838d-5282249e91ed', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3b0859-6878-475b-82d3-bb14b2521fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3b0859-6878-475b-82d3-bb14b2521fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d2aaf8-c7da-4804-9a83-6ffa5bd8ffb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:35 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Volume ba877640-4f0c-4b6d-838d-5282249e91ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba877640-4f0c-4b6d-838d-5282249e91ed', 'volume_size': 1} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415617356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba877640-4f0c-4b6d-838d-5282249e91ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f57d1056886f4df2875bd7bea0d284ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:13:36Z,use_quota=True,user_id='0bec133621ea4098bccf83cc8b3bbeb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Creating volume ba877640-4f0c-4b6d-838d-5282249e91ed {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:13:35 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:13:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:35 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed 1073741824 Nov 04 19:13:35 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:36 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed 1073741824" returned: 0 in 0.411s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:36 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed Nov 04 19:13:36 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:36 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed" returned: 0 in 0.272s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d2aaf8-c7da-4804-9a83-6ffa5bd8ffb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba877640-4f0c-4b6d-838d-5282249e91ed', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe94e767-78fd-42b6-af50-8cf19ea87469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:13:36 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Volume volume-ba877640-4f0c-4b6d-838d-5282249e91ed (ba877640-4f0c-4b6d-838d-5282249e91ed): created successfully Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe94e767-78fd-42b6-af50-8cf19ea87469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Flow 'volume_create_manager' (34c430de-cfcf-4db2-990d-41086aaff85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:13:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b2b9cb9d-384a-40cd-aa8d-be0a5588a4a6 tempest-ProjectMemberTests-4201210 None] Created volume successfully. Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] Creating offline snapshot 031b4ef0-5316-4582-8593-d5f1321dbd19 of volume ba877640-4f0c-4b6d-838d-5282249e91ed {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac193cf6-073a-482e-9403-eae4a3228e6b]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:37 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed Nov 04 19:13:37 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:37 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed" returned: 0 in 0.384s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:37 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 1G Nov 04 19:13:37 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:37 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 1G" returned: 0 in 0.385s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba877640-4f0c-4b6d-838d-5282249e91ed -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:37 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba877640-4f0c-4b6d-838d-5282249e91ed -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 Nov 04 19:13:37 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:37 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba877640-4f0c-4b6d-838d-5282249e91ed -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19" returned: 0 in 0.292s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:37 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 is being set with open permissions: ugo+rw Nov 04 19:13:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:37 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 Nov 04 19:13:37 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:38 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19" returned: 0 in 0.236s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:38 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.info Nov 04 19:13:38 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:38 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.info" returned: 0 in 0.246s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:38 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.info is being set with open permissions: ugo+rw Nov 04 19:13:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:38 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.info Nov 04 19:13:38 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:38 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.info" returned: 0 in 0.235s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:38 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:38 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-d4e607a2-a517-48fc-8c66-d004a15c61d7 tempest-ProjectMemberTests-4201210 None] Create snapshot completed successfully Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-031b4ef0-5316-4582-8593-d5f1321dbd19-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Lock "cinder-031b4ef0-5316-4582-8593-d5f1321dbd19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-ba877640-4f0c-4b6d-838d-5282249e91ed" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-ba877640-4f0c-4b6d-838d-5282249e91ed" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-031b4ef0-5316-4582-8593-d5f1321dbd19" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-031b4ef0-5316-4582-8593-d5f1321dbd19" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Deleting offline snapshot 031b4ef0-5316-4582-8593-d5f1321dbd19 of volume ba877640-4f0c-4b6d-838d-5282249e91ed {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] snapshot_file for this snap is: volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ac6230-c9ea-4a3f-8cdf-f8b152341388]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:39 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 Nov 04 19:13:39 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:39 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19" returned: 0 in 0.361s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba877640-4f0c-4b6d-838d-5282249e91ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e7103d-7fb2-4516-8ba9-5194094a4230]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:39 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed Nov 04 19:13:39 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:39 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed" returned: 0 in 0.359s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:39 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:39 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 Nov 04 19:13:39 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:40 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19" returned: 0 in 0.340s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:40 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19 Nov 04 19:13:40 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:40 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:40 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed.031b4ef0-5316-4582-8593-d5f1321dbd19" returned: 0 in 0.246s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-031b4ef0-5316-4582-8593-d5f1321dbd19" released by "_delete_snapshot" :: held 1.407s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-ba877640-4f0c-4b6d-838d-5282249e91ed" released by "delete_snapshot" :: held 1.429s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:40 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Created reservations ['f72bc4b5-5259-4020-ba2a-bae7ac6216fa', '6f16e08a-3e1f-4ac8-b4e6-1435180c3902', '67042fd6-f15e-4500-9c69-45d081bdf6c1', '9f102f0d-9648-4899-af29-d16defe292e9'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:40 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Delete snapshot completed successfully. Nov 04 19:13:40 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-b834bde6-beee-4c5a-8860-bd5f1ef705b1 tempest-ProjectMemberTests-4201210 None] Lock "cinder-031b4ef0-5316-4582-8593-d5f1321dbd19-delete_snapshot" released by "delete_snapshot" :: held 1.561s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-ba877640-4f0c-4b6d-838d-5282249e91ed-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Lock "cinder-ba877640-4f0c-4b6d-838d-5282249e91ed-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Acquiring lock "cinder-quobyte-ba877640-4f0c-4b6d-838d-5282249e91ed" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:13:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-ba877640-4f0c-4b6d-838d-5282249e91ed" acquired by "delete_volume" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:13:41 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be19f30-a4ab-4a4b-adc4-8b4209a41a71]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:13:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:41 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed Nov 04 19:13:41 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:41 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed" returned: 0 in 0.366s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:41 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed Nov 04 19:13:41 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:41 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:41 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-ba877640-4f0c-4b6d-838d-5282249e91ed" returned: 0 in 0.250s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:41 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Lock "cinder-quobyte-ba877640-4f0c-4b6d-838d-5282249e91ed" released by "delete_volume" :: held 0.675s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:42 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Created reservations ['e8c69f1d-6e02-4927-aa74-724bddf98e2b', '0b1db2cc-c052-4dad-a21e-a47d704bdd42', 'a43caa94-d4df-49f9-bca8-1a542852aebc', '871c7c93-22ca-4a54-9204-9081a0f086f2'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:13:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:13:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:13:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:13:42 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:13:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:13:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:13:42 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:13:42 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:13:42 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Nov 04 19:13:42 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.254s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:13:42 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:13:42 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Deleted volume successfully. Nov 04 19:13:42 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-256780b5-c77b-4d76-8593-c489ddeb8154 tempest-ProjectMemberTests-4201210 None] Lock "cinder-ba877640-4f0c-4b6d-838d-5282249e91ed-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:13:52 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=28,cinder:INSERT=9,cinder:UPDATE=34,cinder:DELETE=1 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:13:52 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:INSERT=9,cinder:UPDATE=30,cinder:SELECT=18,cinder:DELETE=3 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:16 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:14:16 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:16 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.325s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG oslo_service.periodic_task [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] Running periodic task VolumeManager._thread_info {{(pid=87364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread count: 28 {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 04 19:14:16 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-75927fcb-ab28-4724-8e6f-b46dc3e6b3b9 None None] thread info: [<_MainThread(MainThread, started 135790741667968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Flow 'volume_create_manager' (f7b18db9-db60-4031-a006-e8e562d57fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2226931b-ad07-4061-8781-2d2e1cb641ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2226931b-ad07-4061-8781-2d2e1cb641ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-732837887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ca231f-0f89-4020-ad57-bb26a3bdb5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca6b1f8c4294862909138b2aee38487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:20Z,use_quota=True,user_id='7ce2742d29704954b31f64618b198328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9dd6c8-e5f0-4cd6-9bc6-d9b2ac493a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9dd6c8-e5f0-4cd6-9bc6-d9b2ac493a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612e9a37-a061-45e0-909e-4abc50a83d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612e9a37-a061-45e0-909e-4abc50a83d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ca231f-0f89-4020-ad57-bb26a3bdb5da', 'volume_name': 'volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650c9db6-84f2-4582-830a-8654f30b34ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650c9db6-84f2-4582-830a-8654f30b34ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07058a48-46bd-44fb-aae0-3dacdf46c354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:20 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Volume 17ca231f-0f89-4020-ad57-bb26a3bdb5da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da', 'volume_size': 1} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-732837887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ca231f-0f89-4020-ad57-bb26a3bdb5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca6b1f8c4294862909138b2aee38487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:20Z,use_quota=True,user_id='7ce2742d29704954b31f64618b198328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)}" {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Creating volume 17ca231f-0f89-4020-ad57-bb26a3bdb5da {{(pid=87364) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:14:20 devstack cinder-volume[87364]: INFO cinder.volume.drivers.remotefs [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] casted to osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da 1073741824 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:20 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da 1073741824 Nov 04 19:14:20 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:20 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da 1073741824" returned: 0 in 0.453s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:20 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da Nov 04 19:14:20 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:20 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da" returned: 0 in 0.262s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'} {{(pid=87364) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07058a48-46bd-44fb-aae0-3dacdf46c354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da', 'volume_size': 1}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5068153-24b1-4f6f-9fe6-262310d02a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:20 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Volume volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da (17ca231f-0f89-4020-ad57-bb26a3bdb5da): created successfully Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5068153-24b1-4f6f-9fe6-262310d02a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:20 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Flow 'volume_create_manager' (f7b18db9-db60-4031-a006-e8e562d57fa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:20 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-6b07580a-a060-489c-844f-b48bccc10187 tempest-SnapshotDependencyTests-1635260711 None] Created volume successfully. Nov 04 19:14:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:21 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] Creating offline snapshot 7a741e22-02cc-4ee4-9a34-b5a9b48d57dd of volume 17ca231f-0f89-4020-ad57-bb26a3bdb5da {{(pid=87364) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 04 19:14:21 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[48edeed7-6c20-4b6e-b5af-9e7eb4952d39]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:21 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da Nov 04 19:14:21 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:21 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da" returned: 0 in 0.375s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:21 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd 1G {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:21 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd 1G Nov 04 19:14:21 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:22 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd 1G" returned: 0 in 0.439s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:22 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd Nov 04 19:14:22 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:22 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da -F qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd" returned: 0 in 0.336s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:22 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd is being set with open permissions: ugo+rw Nov 04 19:14:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:22 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd Nov 04 19:14:22 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:22 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd" returned: 0 in 0.254s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:22 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:22 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.info Nov 04 19:14:22 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:23 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.info" returned: 0 in 0.261s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:23 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.info is being set with open permissions: ugo+rw Nov 04 19:14:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.info {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:23 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.info Nov 04 19:14:23 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:23 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.info" returned: 0 in 0.258s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:23 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:23 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-9607396e-fdff-41ea-a632-a9972879823a tempest-SnapshotDependencyTests-1635260711 None] Create snapshot completed successfully Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87364) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Flow 'volume_create_manager' (32abe929-18de-4d38-9b7c-def821cac366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54aff4d1-3ea2-4586-85fa-144cd546e14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54aff4d1-3ea2-4586-85fa-144cd546e14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-04T18:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c14330-b54c-43e6-9877-7024593f409c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca6b1f8c4294862909138b2aee38487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T18:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a741e22-02cc-4ee4-9a34-b5a9b48d57dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T18:14:25Z,use_quota=True,user_id='7ce2742d29704954b31f64618b198328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ab4d30-8922-483e-915e-4e1bd5e6de85),volume_type_id=b4ab4d30-8922-483e-915e-4e1bd5e6de85)' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efd1f7d-0773-4667-bdc6-8908f35901a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efd1f7d-0773-4667-bdc6-8908f35901a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e9e88e-1f56-4235-8c1b-fd9ae6ee6bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e9e88e-1f56-4235-8c1b-fd9ae6ee6bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '01c14330-b54c-43e6-9877-7024593f409c', 'volume_name': 'volume-01c14330-b54c-43e6-9877-7024593f409c', 'volume_size': 1, 'snapshot_id': '7a741e22-02cc-4ee4-9a34-b5a9b48d57dd'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aaeb0c-037f-4e07-9741-a1152dfc5da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aaeb0c-037f-4e07-9741-a1152dfc5da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2d7fce-a623-4a4e-a737-495097f48971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:25 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Volume 01c14330-b54c-43e6-9877-7024593f409c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-01c14330-b54c-43e6-9877-7024593f409c', 'volume_size': 1, 'snapshot_id': '7a741e22-02cc-4ee4-9a34-b5a9b48d57dd'} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "cinder-quobyte-7a741e22-02cc-4ee4-9a34-b5a9b48d57dd-01c14330-b54c-43e6-9877-7024593f409c" by "_create_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-7a741e22-02cc-4ee4-9a34-b5a9b48d57dd-01c14330-b54c-43e6-9877-7024593f409c" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Creating volume 01c14330-b54c-43e6-9877-7024593f409c from snapshot 7a741e22-02cc-4ee4-9a34-b5a9b48d57dd {{(pid=87364) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Selected osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6 as target Quobyte volume. {{(pid=87364) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "cinder-quobyte-01c14330-b54c-43e6-9877-7024593f409c" by "_copy_volume_from_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-01c14330-b54c-43e6-9877-7024593f409c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] snapshot: 7a741e22-02cc-4ee4-9a34-b5a9b48d57dd, volume: 01c14330-b54c-43e6-9877-7024593f409c, {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ce7a96-d85f-4e33-9989-d43ad9b8e725]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:25 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd Nov 04 19:14:25 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:25 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd" returned: 0 in 0.370s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66038a8-e069-4c74-8ad9-e702ce7f3bca]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:25 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:25 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da Nov 04 19:14:25 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:26 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da" returned: 0 in 0.399s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 04 19:14:26 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Creating direct copy from snapshot {{(pid=87364) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 04 19:14:26 devstack cinder-volume[87364]: DEBUG cinder.utils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Path /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c not found in is_blk_device check {{(pid=87364) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 04 19:14:26 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:26 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c Nov 04 19:14:26 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:32 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c" returned: 0 in 6.017s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.image.image_utils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Image conversion details: src /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c {{(pid=87364) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 04 19:14:32 devstack cinder-volume[87364]: INFO cinder.image.image_utils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Converted 1024.00 MB image at 170.16 MB/s Nov 04 19:14:32 devstack cinder-volume[87364]: WARNING cinder.volume.drivers.remotefs [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c is being set with open permissions: ugo+rw Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:32 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c Nov 04 19:14:32 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:32 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c" returned: 0 in 0.233s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-01c14330-b54c-43e6-9877-7024593f409c" released by "_copy_volume_from_snapshot" :: held 7.104s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-7a741e22-02cc-4ee4-9a34-b5a9b48d57dd-01c14330-b54c-43e6-9877-7024593f409c" released by "_create_volume_from_snapshot" :: held 7.169s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.189s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2d7fce-a623-4a4e-a737-495097f48971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c14330-b54c-43e6-9877-7024593f409c', 'volume_size': 1, 'snapshot_id': '7a741e22-02cc-4ee4-9a34-b5a9b48d57dd'}' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a7d880-74a5-4f34-a3eb-1db0caffe129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 04 19:14:32 devstack cinder-volume[87364]: INFO cinder.volume.flows.manager.create_volume [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Volume volume-01c14330-b54c-43e6-9877-7024593f409c (01c14330-b54c-43e6-9877-7024593f409c): created successfully Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a7d880-74a5-4f34-a3eb-1db0caffe129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87364) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Flow 'volume_create_manager' (32abe929-18de-4d38-9b7c-def821cac366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87364) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 04 19:14:32 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ccdef0e8-4244-4ac5-9a8b-84d51e7e0b08 tempest-SnapshotDependencyTests-1635260711 None] Created volume successfully. Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "cinder-7a741e22-02cc-4ee4-9a34-b5a9b48d57dd-delete_snapshot" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-7a741e22-02cc-4ee4-9a34-b5a9b48d57dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "cinder-quobyte-17ca231f-0f89-4020-ad57-bb26a3bdb5da" by "delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-17ca231f-0f89-4020-ad57-bb26a3bdb5da" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "cinder-quobyte-7a741e22-02cc-4ee4-9a34-b5a9b48d57dd" by "_delete_snapshot" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-7a741e22-02cc-4ee4-9a34-b5a9b48d57dd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Deleting offline snapshot 7a741e22-02cc-4ee4-9a34-b5a9b48d57dd of volume 17ca231f-0f89-4020-ad57-bb26a3bdb5da {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] snapshot_file for this snap is: volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd {{(pid=87364) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[15226160-4c74-4e2d-bd83-b09be12fe557]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:32 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:32 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd Nov 04 19:14:32 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:33 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd" returned: 0 in 0.349s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:33 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.remotefs [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87364) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 04 19:14:33 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[603ed358-7b2b-4654-9995-afcf15256895]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:33 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da Nov 04 19:14:33 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:33 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da" returned: 0 in 0.527s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:33 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:33 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd Nov 04 19:14:33 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:34 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd" returned: 0 in 0.321s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:34 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd Nov 04 19:14:34 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:34 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:34 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da.7a741e22-02cc-4ee4-9a34-b5a9b48d57dd" returned: 0 in 0.251s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-7a741e22-02cc-4ee4-9a34-b5a9b48d57dd" released by "_delete_snapshot" :: held 1.545s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-17ca231f-0f89-4020-ad57-bb26a3bdb5da" released by "delete_snapshot" :: held 1.571s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:34 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Created reservations ['52702422-ba8a-4681-bbc5-add5c1b1845b', 'a95bdfc2-cdeb-43aa-9bea-675d245ac76c', '608f34a7-2b16-478e-a543-7a1405f37065', '2a38a7e4-7323-49e1-856e-9e60e1e907fe'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:34 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Delete snapshot completed successfully. Nov 04 19:14:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-31570b0f-01c6-4137-8911-af36c8cfcb30 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-7a741e22-02cc-4ee4-9a34-b5a9b48d57dd-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "cinder-17ca231f-0f89-4020-ad57-bb26a3bdb5da-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-17ca231f-0f89-4020-ad57-bb26a3bdb5da-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:34 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "cinder-quobyte-17ca231f-0f89-4020-ad57-bb26a3bdb5da" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-17ca231f-0f89-4020-ad57-bb26a3bdb5da" acquired by "delete_volume" :: waited 0.021s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbf0c7a-50ab-4010-b12c-2d716d1e8b77]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:35 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da Nov 04 19:14:35 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:35 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da" returned: 0 in 0.370s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:35 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da Nov 04 19:14:35 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:35 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-17ca231f-0f89-4020-ad57-bb26a3bdb5da" returned: 0 in 0.245s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-17ca231f-0f89-4020-ad57-bb26a3bdb5da" released by "delete_volume" :: held 0.683s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Created reservations ['d38d45fa-4632-484f-a0d7-5830ba43a8b9', '332bb4b5-4909-4318-ac05-0cbd96e2bbab', '13e4c3d0-af38-4e7f-9132-cff2fe22c0de', '9c246a84-6c19-4277-9bf4-890fbde512f7'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:35 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:35 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:14:35 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:36 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.279s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:36 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Deleted volume successfully. Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "cinder-01c14330-b54c-43e6-9877-7024593f409c-delete_volume" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-be8896f6-ab68-471b-bf3b-9ef3fed399db tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-17ca231f-0f89-4020-ad57-bb26a3bdb5da-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-01c14330-b54c-43e6-9877-7024593f409c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "cinder-quobyte-01c14330-b54c-43e6-9877-7024593f409c" by "delete_volume" {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-01c14330-b54c-43e6-9877-7024593f409c" acquired by "delete_volume" :: waited 0.017s {{(pid=87364) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80898e0-dc26-465c-acf6-1d662d8cee77]: (4, 'qcow2') {{(pid=88580) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:36 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c Nov 04 19:14:36 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:36 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c" returned: 0 in 0.380s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:36 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c Nov 04 19:14:36 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:36 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252/volume-01c14330-b54c-43e6-9877-7024593f409c" returned: 0 in 0.250s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-quobyte-01c14330-b54c-43e6-9877-7024593f409c" released by "delete_volume" :: held 0.675s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG cinder.quota [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Created reservations ['dec4ba74-db4b-4d1e-88c5-c6b36e8a77b8', 'df538054-4ebf-4787-b50b-993cb210c808', '0f7698b5-d43b-4cfe-9be9-98905f77d458', '7c0850fd-1576-49db-a30e-e9f042ef374f'] {{(pid=87364) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6': None} {{(pid=87364) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG cinder.volume.drivers.quobyte [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cbf51879-32f1-4127-9dca-2b6a2f7e48b6'] {{(pid=87364) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.lockutils [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87364) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 04 19:14:36 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 04 19:14:37 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252 Nov 04 19:14:37 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 04 19:14:37 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Nov 04 19:14:37 devstack cinder-volume[87364]: DEBUG oslo_concurrency.processutils [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/312ba026726bf3f70c94dfe51e433252" returned: 0 in 0.288s {{(pid=87364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 04 19:14:37 devstack cinder-volume[87364]: DEBUG cinder.manager [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Notifying Schedulers of capabilities ... {{(pid=87364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 04 19:14:37 devstack cinder-volume[87364]: INFO cinder.volume.manager [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Deleted volume successfully. Nov 04 19:14:37 devstack cinder-volume[87364]: DEBUG cinder.coordination [None req-ed3707fa-1341-486e-8daa-3a77621153f5 tempest-SnapshotDependencyTests-1635260711 None] Lock "cinder-01c14330-b54c-43e6-9877-7024593f409c-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87364) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 04 19:14:46 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 04 19:14:47 devstack cinder-volume[87364]: DEBUG dbcounter [-] [87364] Writing DB stats cinder:SELECT=22,cinder:INSERT=10,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=87364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}